Tech News

ChatGPT Mac App with Screen-Viewing Feature Could Have Ethical Considerations

Highlights

OpenAI introduces the native Mac app for ChatGPT with new screen-viewing capabilities.
GPT-4o, the latest flagship model, unveiled with enhanced AI features.
Speculations about Apple-OpenAI collaboration for iOS 18.
New ChatGPT feature to assist in tasks by viewing screen content.

In its new spring update, OpenAI released a native Mac app for ChatGPT, and also unveiled its newest flagship model: GPT-4o.

There were stunning demonstrations and a palpable feeling in the air—so much so that Apple users were highly speculating about a possible Apple-OpenAI collaboration for iOS 18.

ChatGPT App for Desktop

ChatGPT Mac App with Screen-Viewing Feature Could Have Ethical Considerations

One of the exciting moments from the event was when it released a sneak peek of a new feature for the ChatGPT app, though details were not made available.

This feature would make ChatGPT see what’s going on on every pixel of your device’s screen.

The desktop application, designed to open in a small window, may be particularly useful.

It lets the AI assistant view your screen to assist in tasks such as coding problems.

In this way, the functionality aspires to make it easier to use ChatGPT for daily tasks.

Would you feel confident sharing your screen with ChatGPT?

At launch, users are able to manually screenshot capture or upload files for ChatGPT to assess.

In the near future, as shown in the video, the app will let users unlock full access to your screen content with a single click.

Later, as the video below shows, users will be able to allow the app full access to what’s on their screen in a single click.

It will not be restricted to Macs, though; the iOS and iPadOS apps also displayed this technology in a tutoring context.

ChatGPT Reading Your Screen

OpenAI introduces the native Mac app for ChatGPT with new screen-viewing capabilities

The timeline for the release of these screen-viewing features in ChatGPT remains uncertain but is viewed as a natural enhancement to a more interactive user experience.

Apple provides APIs that developers can use to access screen content, with user consent, ensuring that OpenAI’s approach is ethical.

At the launch of GPT-4o, OpenAI underlined its potential to revolutionize work.

Initially, the World Economic Forum estimated that LLMs would impact about 40% of working hours.

Now, some believe this could increase to 90%, potentially making workers either significantly more productive or much lazier.

Sam Altman stressed that an AI assistant should act like a “senior employee” rather than an “agent.”

Unlike an agent that follows commands without question, a senior employee would challenge requests that seem illogical.

FAQs

What is the new feature in the ChatGPT Mac app?

The new feature allows ChatGPT to see and interact with the content on your screen, aiding tasks such as coding problems.

Initially, users can manually capture or upload screenshots, with future updates enabling full screen access with a single click.

Will the screen-viewing feature be available on other platforms?

Yes, the screen-viewing feature will also be available on iOS and iPadOS apps, demonstrating its utility in a tutoring context and providing a more interactive user experience across devices.

What is GPT-4o and what are its capabilities?

GPT-4o is OpenAI’s latest flagship model, offering significantly faster response times, improved natural language processing, and the ability to integrate with various applications.

It aims to enhance productivity and provide more nuanced responses.