Moore’s Law for AI. Is there such a thing?
Moore's law is the observation that the number of transistors in an integrated circuit (IC) doubles about every two years.
Is there anything similar for the sophistication of AI, or AGI in particular?
You are viewing a single comment
Some in the AI industry have proposed concepts similar to Moore's Law to describe the rapid growth of AI capabilities.
Although there is no universally accepted law or principle akin to Moore's Law for AI, people often refer to trends that describe the doubling of model sizes or capabilities over a specific time frame.
For instance, OpenAI has previously described a trend where the amount of computing power used to train the largest AI models has been doubling roughly every 3.5 months since 2012.
Source
Thank you!
But does that equate to the power of AI doubling every 3.5 months?
I guess it's hard to measure the power of AI anyway but I would say a strong no: it doesn't equate to the power of AI doubling every 3.5 months 😅