New Frontiers You Never Knew That They Exist: Transparency and On-Device Processing

The push for AI transparency and the shift towards on-device generative AI.

Hi, it's Omar. Today's newsletter is 1,084 words, a 4.5-minute read.

Let me get you ready for the next week with this week’s newsletter:

1. The Push for AI Transparency: A Call To Action

The AI industry is at a pivotal juncture. As AI technologies continue to advance, the clamour for transparency and ethical considerations grows louder. A groundbreaking transparency index, developed by luminaries from Stanford, MIT, and Princeton, has thrust this issue into the limelight.

Why it matters: The index, which scrutinizes AI models against 100 transparency indicators, reveals a concerning landscape. With an average score of just 37 out of 100, the AI industry's commitment to transparency is under scrutiny. Kevin Klyman, a co-author of the study, emphasized to Axios the absence of information on the real-world impacts of these systems.

The bigger picture: Despite the transformative potential of AI, self-regulation has proven inadequate. The launch of models like ChatGPT has intensified the industry's penchant for secrecy, often under the guise of competitive and safety concerns. A paper accompanying the new index resoundingly declares, "Transparency should be a top priority for AI legislation."

Driving the news: Senate Majority Leader Chuck Schumer is taking proactive steps. As he rallies AI experts, the undercurrents suggest a burgeoning momentum for AI legislation.

Details: The index's findings are eye-opening. Only two of the 10 models evaluated scored above 50%. All exhibited significant transparency gaps. Yet, with 82 of the 100 criteria met by at least one developer, there's a roadmap for improvement. The researchers are optimistic, urging AI developers to emulate best practices and enhance transparency.

The other side: Amazon, whose Titan model languished at the bottom of the rankings, contends that their product was evaluated prematurely. Nathan Strauss, an Amazon spokesperson, argued that Titan Text is still in its "private preview" phase.

The intrigue: While some developers, like OpenAI and Cohere, champion specific transparency actions, others appear to be retreating. Stanford's Rishi Bommasani, another index co-author, observes a trend: Major developers are becoming less transparent.

What they're saying: Klyman's sentiments encapsulate the prevailing mood, "It's worrying that companies often do not share rigorous evaluations of how their models could be misused." In an era marked by discussions on AI's potential risks, this clarion call for transparency is resonating across the industry.

2. Qualcomm's Ambitious Leap: The push to run generative AI on devices

Generative AI, once tethered to the vast expanse of the cloud, is making an interesting transition to our pockets and desks. Big tech players are fervently pushing to run these AI models directly on smartphones and laptops, heralding a new era of AI accessibility and efficiency.

Why it matters: On-device AI promises a trifecta of benefits: cost-efficiency, speed, and enhanced privacy. Qualcomm's recent demonstration, where a reference smartphone running Stable Diffusion produced an image in under a second, underscores this potential. Contrast this with a similar task earlier this year that took a whopping 15 seconds.

Apple's AI Endeavors: Apple, initially caught off-guard by the generative AI wave, is now doubling down on its efforts. Rumours suggest that the tech giant is revamping Siri and other apps, integrating broader AI functionalities. This on-device approach aligns seamlessly with Apple's staunch privacy ethos, minimizing data relayed to their servers.

Google and Qualcomm's Collaboration: Google's Pixel devices already harness on-device AI, especially for photo enhancements. In a recent announcement, Google revealed its collaboration with Qualcomm to bring several of its AI models to Android devices.

The Bigger Picture: The allure of generative AI isn't just its prowess in drafting documents or sifting through data. The real game-changer is the potential cost savings. As Qualcomm's senior vice president Alex Katouzian points out, the escalating cloud costs are nudging companies to optimize on-device capabilities.

Qualcomm's Bold Move: Qualcomm's unveiling of the Snapdragon Elite X, a processor that challenges even the fastest laptop chips from Apple and Intel, is a testament to their ambition. Stemming from their $1.4 billion Nuvia acquisition, this chip promises unparalleled performance and energy efficiency. Qualcomm's CEO, Cristiano Amon, confidently showcased the Snapdragon X Elite's prowess, even outperforming Apple and Intel's best on specific benchmarks.

Yes, but: It's crucial to note that Qualcomm's comparisons are against current offerings from Apple and Intel. The tech landscape is ever-evolving, and competitors are unlikely to remain static.

The Legal Quagmire: Qualcomm's ambitious strides haven't been without hurdles. ARM's lawsuit against Qualcomm, centred on licensing issues with Nuvia's technology, adds a layer of complexity to the narrative. With billions at stake, the legal battle is rife with twists and subplots.

In Conclusion: The shift towards on-device generative AI is more than just a technological evolution; it's a paradigm shift. As Qualcomm and other tech giants lead the charge, the future of AI promises to be more personal, efficient, and transformative than ever before.

eToro

🌟 Sponsor Spotlight: eToro - Your Gateway to Investing in AI’s Future! 🌟

  • 🚀 Pioneer the Future: Join the AI revolution and shape the future with technology boasting a 40% growth rate!

  • 💰 Seamless Investing: eToro offers a user-friendly and secure platform, opening doors to AI investment opportunities!

  • 🌟 Unlock Possibilities: Invest early in AI with eToro and unlock potential substantial rewards. Start now!

Your capital is at risk, 76% of retail investor accounts lose money when trading CFDs with this provider.

Cool AI-enabled tools for you:

  1. Portfolio Magic by Contra - AI-driven portfolio builder with integrated payments and analytics.

  2. Wave - AI tool for intelligent note-taking, summaries, and transcriptions.

  3. HelpKit AI – Enhances your Notion knowledge base using AI.

  4. Instagraph - Transforms text or URLs into visual knowledge graphs.

  5. ExLlama V2 - Library for running LLMs on consumer GPUs.

  6. JS2TS - Uses ChatGPT to convert JavaScript to TypeScript.

  7. CustomerIQ - AI workspace for capturing and analyzing customer feedback.

8 other developments from the past week...

  1. 10 Graphs: That Sum Up the State of AI in 2023. Link!

  2. Adobe: unveiled a novel tool for vector illustrations among new AI models on Tuesday. Link!

  3. Southeast Asian: bloc favours a laissez-faire approach to AI, EU still wants strong regulations. Link!

  4. Google: Insiders Question Usefulness of Bard AI Chatbot. Link!

  5. Google: to defend generative AI users from copyright claims. Link!

  6. OpenAI: plans major updates to lure developers with lower costs. Link!

  7. Andreessen: Horowitz Discussed Backing a Rival to Midjourney. Link!

  8. AI: Is Coming for Sales Execs’ Jobs—and They’re Celebrating. Link!

Thanks for Reading! 🌟

Is this helpful? Please share with friends and connect with us on Twitter and LinkedIn for more updates!

Best,

Omar Ajruli,
Chief Editor