This paper delves into the carbon footprint generated by AI chips during their training and operational phases. It highlights the often-overlooked environmental impact of training AI models like ChatGPT, emphasizing the significant CO2 emissions and computational demands involved. The paper also explores the paradoxical nature of AI, which, while contributing to climate change, also holds potential in combating its effects. This dual role of AI sparks ethical debates, particularly concerning strategies to minimize the carbon emissions associated with AI training. Some potential solutions, such as increased transparency among AI-utilizing companies and the adoption of analog-in-memory computing, to address these challenges while also continuing to push the boundaries of AI computing.