AllYouCanTech

Economical AI Solutions Now Able to Retrieve Data from Any Screen Capture

# AI Video Scraping: Transforming Data Acquisition with Multimodal Models

In an ever-changing digital landscape, artificial intelligence (AI) persistently forges ahead, delivering groundbreaking solutions to common obstacles. One such innovation is **video scraping**, a method that utilizes AI to extract essential information from screen recordings. This technique, introduced by AI researcher Simon Willison, highlights the capabilities of multimodal AI models like Google’s **Gemini** in processing and evaluating video content, paving the way for new avenues in data extraction and engagement with digital contexts.

## What Is Video Scraping?

Video scraping entails capturing a screen recording and inputting it into an AI model to extract organized data from the footage. This strategy proves particularly beneficial when information is dispersed across various sources, such as emails, websites, or applications, where manual collection would consume considerable time.

Willison showcased this by creating a 35-second video of his emails, which featured scattered payment amounts and dates. Instead of entering the data manually, he utilized **Google’s AI Studio** to analyze the video using the **Gemini 1.5 Flash** model. The AI efficiently retrieved the pertinent data, which Willison subsequently formatted into a **JSON** (JavaScript Object Notation) file and later into a **CSV** (Comma-Separated Values) table for spreadsheet applications.

The entire process proved not only precise but also economical. Willison noted that the complete video analysis consumed merely 11,018 tokens, costing less than a tenth of a cent—a minute expense, especially given the time conserved. Currently, Google AI Studio remains available for free usage in certain contexts, making it an inviting resource for experimentation.

## The Strength of Multimodal AI Models

Video scraping is facilitated by advancements in **multimodal AI models**, which can handle diverse forms of input, including text, images, audio, and video. These models, such as **Google’s Gemini** and **OpenAI’s GPT-4o**, decompose multimedia inputs into **tokens**—small data segments utilized by the AI to predict subsequent token sequences. This functionality empowers AI to understand and engage with intricate data formats, like video, in ways previously deemed impossible.

Multimodal models signify a considerable advancement over traditional **Large Language Models (LLMs)**, which primarily focus on textual content. As AI progresses, the designation **Token Prediction Model (TPM)** may become more fitting for these systems, reflecting their expanded capabilities beyond just language inputs.

## Overcoming Data Obstacles

For data journalists like Willison, video scraping presents a robust tool for transforming **unstructured data** into **structured data**. This is particularly advantageous when conventional data extraction approaches, such as web scraping, face challenges due to complex or inaccessible formats. By recording a video of displayed data on a screen, users can overcome these hurdles and input the visual information directly into an AI model for examination.

In a past experiment, Willison employed video scraping to catalog the titles of books on his bookshelf. He filmed a brief video of the shelves and asked **Gemini 1.5 Pro** to retrieve the book titles, organizing them into a structured format. This example illustrates the adaptability of video scraping, which can be utilized across various data extraction endeavors.

## Video as a Novel Input Method

The ramifications of video scraping extend beyond the realm of data journalism. As AI models grow increasingly proficient in processing video, they could aid users in navigating intricate digital environments. For instance, an AI might observe a user struggling with a poorly designed website and intervene to execute necessary actions, such as completing an order or submitting a form.

Leading tech firms are already investigating these possibilities. **Google**, **OpenAI**, and **Microsoft** have all showcased prototypes allowing AI to “perceive” and interact with activities on a user’s screen. **Microsoft’s Copilot Vision**, for example, embodies a concept that permits AI to monitor a user’s screen and assist with tasks in real-time. Likewise, **OpenAI’s ChatGPT Mac App** has hinted at a feature enabling the AI to engage with on-screen content, although it has yet to be made available to the public.

## Privacy Challenges and Ethical Considerations

While video scraping unveils thrilling opportunities, it also prompts considerable privacy concerns. The capacity for AI to “see” and scrutinize everything displayed on a user’s screen could be misused for nefarious aims, such as surveillance or unauthorized data gathering. Applications like **Rewind AI** and **Microsoft’s Recall** already implement similar methods to record and archive all user actions on their computers, igniting discussions about privacy and data safety.

Willison’s methodology regarding video scraping, however, prioritizes user autonomy. By selectively recording and submitting specific videos for analysis, users maintain control over the information they share with the AI. This approach contrasts with continuous recording applications, which

Data Breach Reveals Customer Details from 2K Redbox Rentals

# The Redbox Bankruptcy: A Data Privacy Catastrophe on the Horizon

In recent times, the downturn of physical media has become clear, with streaming platforms dominating the entertainment landscape. One of the most emblematic icons of the DVD rental age, Redbox, has encountered considerable difficulties. The company, previously a leading force in the rental industry, has now sought Chapter 7 bankruptcy under its parent organization, Chicken Soup for the Soul. While many express worries about the fate of the red kiosks and DVDs, a significantly more urgent matter has surfaced: the potential risk of sensitive customer information stored on Redbox kiosks being compromised.

## The Downfall of Redbox and Its Consequences

Redbox, famous for its user-friendly DVD rental kiosks found in grocery stores, pharmacies, and various retail environments, has been struggling amid the digital streaming surge. In June, Chicken Soup for the Soul initiated Chapter 7 bankruptcy proceedings, marking the liquidation of Redbox’s assets. As retailers hurry to eliminate the now-outdated kiosks, certain machines have ended up in the possession of hobbyists and tech enthusiasts.

While some individuals have creatively found new uses for the kiosks—such as operating the classic game *Doom* on them—others have uncovered a more troubling issue: the possibility of sensitive customer data being retrieved from the kiosks’ hard drives.

## The Data Privacy Dilemma

As reported by Lowpass and reverse engineer Foone Turing, certain Redbox kiosks possess a significant amount of customer information, including transaction histories, email addresses, zip codes, and even fragments of credit card numbers. Turing managed to recover records for more than 2,400 transactions from a Redbox hard drive, with data traced back to at least 2015. This information was kept locally on the kiosks, presumably as a backup in the event of internet failures.

Although the data saved on these kiosks represents merely a fraction of Redbox’s total transactions, the fact that any customer information is at risk is troubling. Turing’s discoveries indicate that Redbox did not implement sufficient measures to secure or adequately erase sensitive data from its kiosks prior to their decommissioning.

### What Information Was Compromised?

Turing’s research showed that the kiosks logged comprehensive details regarding rental transactions, including:

– **Customer email addresses and zip codes**
– **Titles of rented DVDs** and their rental dates
– **Partial credit card numbers** (the first six and last four digits)
– **Lower-tier transaction specifics** related to payments

While the kiosks lacked full credit card information storage, the presence of partial data combined with other identifying details still poses a significant risk to customers, especially if correlated with other data repositories.

## How Simple Was It to Access the Data?

According to Turing, extracting the data from the Redbox hard drive was relatively uncomplicated. Utilizing common, free tools, she could crack the hard drive image and recover the customer details. She observed that although the data was dispersed across various logs and databases, assembling the information was fairly effortless with basic hacking abilities.

“The device contains numerous logs, and customer details were distributed among several of them—typically fragmentary, but it’s rather easy to cross-reference them with other logs,” Turing elaborated. “With complete access to the hard drive, searching for items like email addresses and credit card numbers is straightforward.”

This level of accessibility underscores a significant weakness in Redbox’s data security protocols. The kiosks were designed to function autonomously, necessitating self-decryption without human assistance. This absence of encryption or secure data storage rendered customer information exposed to anyone with access to the hard drive.

## Legal and Fiscal Ramifications

The revelation of customer data from Redbox kiosks gives rise to serious legal and financial issues. In a court document filed in August 2024, Automated Kiosk Advisors LLC issued a warning regarding the potential hazards linked to inadequately removing and destroying the internal data storage within Redbox kiosks. The document stressed that Redbox hard drives must undergo secure reformatting to avert the exposure of sensitive personal data, such as credit card numbers, email addresses, and rental records.

The mishandling of customer data could also breach consumer privacy laws, such as the **Video Privacy Protection Act (VPPA)**, which forbids the improper disclosure of video rental information. However, with Chicken Soup for the Soul undergoing bankruptcy proceedings, holding the company liable for any data breaches may be a daunting task.

## The Wider Privacy Challenge

While the Redbox predicament raises alarm, it is not an isolated case. Turing pointed out that similar privacy concerns frequently arise across numerous sectors, particularly regarding devices that locally store customer data. The insufficient implementation of data security measures and the failure to properly erase information before retiring devices are recurring issues that place consumers in jeopardy.

Mario Trujillo, a legal representative for the **Electronic Frontier Foundation (EF)

“Sisterhood Faces Daunting Opponent in Latest ‘Dune: Prophecy’ Trailer”

# **Dune: Prophecy – An Exciting Addition to the Dune Universe**

The eagerly awaited prequel series, *Dune: Prophecy*, is scheduled to debut on HBO and Max on November 17, 2024. Adherents of the *Dune* universe, crafted by Frank Herbert, have been impatiently anticipating this fresh chapter, which aims to explore the roots of the Bene Gesserit, one of the most mysterious and influential factions within the *Dune* narrative.

## **A Peek into the Storyline**

As disclosed at New York Comic-Con, the series will delve into events occurring 10,000 years prior to Paul Atreides’ emergence, the key figure in *Dune*. *Dune: Prophecy* will center on two Harkonnen sisters, Valya and Tula, as they maneuver through a landscape filled with political machinations, power conflicts, and the imminent dangers of forces capable of altering humanity’s destiny. These sisters will be instrumental in the formation of the Bene Gesserit, a clandestine sisterhood recognized for their remarkable mental and physical skills, alongside their sway over the Imperium’s political dynamics.

### **Official Synopsis**

The series’ official synopsis states:

> *”Taking place 10,000 years before the rise of Paul Atreides, Dune: Prophecy follows two Harkonnen sisters as they face off against forces jeopardizing humanity’s future, while establishing the renowned sect known as the Bene Gesserit.”*

The show will investigate the early formation of the Bene Gesserit, their ascent to power, and the complex political strategies that will influence the Imperium’s future.

## **Talented Ensemble Cast**

The cast of *Dune: Prophecy* is filled with exceptional talent, bringing to life a varied range of characters from the *Dune* universe:

– **Emily Watson** plays Valya Harkonnen, the head of the Sisterhood, a character pivotal to the establishment of the Bene Gesserit.
– **Olivia Williams** embodies Tula Harkonnen, Valya’s sibling, who will join her in the struggle to protect humanity’s future.
– **Mark Strong** portrays Emperor Javicco Corrino, the sovereign of the Imperium, while **Jodhi May** takes on the role of Empress Natalya.
– **Sarah-Sofie Boussnina** will interpret Princess Ynez, introducing additional royal intricacies to the plot.

Other prominent cast members include **Shalom Brune-Franklin** as Mikaela, a Fremen woman aiding the royal family, **Travis Fimmel** as Desmond Hart, a soldier with a mysterious background, and **Chris Mason** as Keiran Atreides, an adept swordsman. Additionally, the series will feature **Tabu** as Sister Francesca, **Jihae** as Reverend Mother Kasha, and **Faoileann Cunningham** as Sister Jen, among others.

## **The Team Behind the Show**

The series is directed by showrunner **Alison Schapker**, recognized for her contributions to *Alias*, *Fringe*, and *Altered Carbon*. **Denis Villeneuve**, who directed the 2021 *Dune* film, serves as an executive producer, ensuring the visual and thematic continuity that fans expect from the *Dune* series.

The show draws inspiration from the novel *Sisterhood of Dune*, authored by **Brian Herbert** (Frank Herbert’s son) and **Kevin J. Anderson**. While it is uncertain how closely the narrative will align with the book, viewers can anticipate a deep examination of the Bene Gesserit’s early history and the political complexities that characterize the *Dune* universe.

## **Sneak Peeks and Trailers**

The initial teaser for *Dune: Prophecy* was unveiled in May 2024 during the Warner Bros. Discovery Upfront presentation in New York City. The teaser provided insight into the inception of the Sisterhood, with a voiceover outlining their objective to assist the Great Houses in “sifting truth from lies.” The teaser suggested a marriage orchestrated by the Sisterhood to position one of their members on the throne, although consensus among them regarding this strategy is lacking.

A subsequent teaser, released in July 2024, offered a more detailed look at the political drama that will propel the series. It showcased ominous alerts, intense close-quarters combat, and an escalating tension as the Imperium teeters on the edge of turmoil. Valya Harkonnen’s voiceover in the trailer sums up the stakes:

> *”The Sisterhood attracts women from numerous worlds to advance our species and determine the future. The Imperium is delicate. The great houses vie for authority. Now is the

Decrease in US Childhood Vaccinations as Increasing Number of Parents Choose Not to Immunize

# US Becomes Increasingly Susceptible to Outbreaks as Vaccination Rates Diminish to 92 Percent

The United States is confronting an escalating public health issue as the immunization rates among kindergartners persist in their downward trend, rendering the nation more susceptible to outbreaks of preventable illnesses. Recent figures from the Centers for Disease Control and Prevention (CDC) indicate that vaccination levels for essential childhood immunizations have fallen to about 92 percent for the 2023–2024 academic year, down from 93 percent the year prior, and 95 percent in 2019–2020. This reduction is troubling, as it distances the country from the 95 percent vaccination benchmark necessary to sustain herd immunity and curb the transmission of vaccine-preventable diseases, including measles, whooping cough, and polio.

## The Escalating Risk of Vaccine-Preventable Illnesses

Diseases such as measles, whooping cough (pertussis), polio, and tetanus, which were largely under control or eradicated in the US, are now poised for a potential comeback. Vaccines for these illnesses have demonstrated safety and efficacy over the years, yet an increasing number of parents are choosing not to vaccinate their children, citing personal or philosophical beliefs instead of medical reasons.

The CDC’s review revealed that vaccination exemptions have surged to a record high of 3.3 percent, an increase from 3 percent in the last academic year. Alarmingly, merely 0.2 percent of these exemptions are medically warranted, indicating that the overwhelming majority are predicated on personal convictions rather than healthcare needs. This trend is alarming, as it jeopardizes the collective immunity that shields communities from outbreaks.

## Decreasing Vaccination Rates: A Nationwide Issue

The CDC’s findings underscore that vaccination rates for four essential immunizations—MMR (measles, mumps, and rubella), DTaP (diphtheria, tetanus, and pertussis), VAR (chickenpox), and polio—have diminished across the nation. Specifically:

– **MMR coverage** has decreased to 92.7 percent, leaving approximately 280,000 kindergartners vulnerable to measles, mumps, or rubella.
– **DTaP coverage** has contracted to 92.3 percent, increasing the risk of whooping cough, a highly transmissible respiratory illness.
– **Polio vaccination** rates have plummeted to 92.6 percent, heightening fears about the resurgence of a disease capable of causing paralysis and potentially fatal outcomes.
– **VAR coverage** for chickenpox has fallen to 92.4 percent.

These declines, although seemingly minor, are crucial as they signify a rising number of children who are unprotected and at risk of these diseases. Herd immunity, which safeguards those who cannot be vaccinated (like infants or individuals with weakened immune systems), demands a vaccination rate of at least 95 percent for the majority of illnesses. Dropping below this level amplifies the risk of outbreaks, especially in areas with lower vaccination coverage.

## Increase in Exemptions

The uptick in vaccination exemptions is a significant contributor to the overall fall in vaccination rates. CDC’s findings indicate that 41 states and the District of Columbia experienced a rise in the number of kindergartners with one or more vaccine exemptions. Fourteen states now report exemption rates exceeding 5 percent, suggesting that even if all non-exempt children were vaccinated, these states would still not meet the 95 percent standard required for herd immunity.

This presents a stark contrast to the 2020–2021 academic year, during which only two states had exemption rates that jeopardized their ability to reach the 95 percent threshold. The increase in exemptions is predominantly due to non-medical reasons, with parents citing religious or philosophical opposition to vaccines. This trend is especially worrisome in states such as Idaho, where vaccination rates for critical vaccines linger around 80 percent, and the exemption rate stands at an alarming 14.3 percent.

## At-Risk Communities and Outbreak Threats

While the national vaccination rate hovers around 92 percent, it’s vital to acknowledge that vaccination levels can vary dramatically by state, city, and even neighborhood. Areas with clusters of low vaccination rates are particularly vulnerable to outbreaks of vaccine-preventable illnesses. When substantial numbers of unvaccinated groups congregate, it becomes easier for infectious diseases to spread.

In recent years, the US has already witnessed surges in outbreaks of diseases like measles and whooping cough. For instance, in 2019, the US recorded the largest measles outbreak in over 25 years, with upwards of 1,200 cases documented. Many of these incidents were associated with communities exhibiting low vaccination rates. As vaccination levels continue to wane, the danger of comparable outbreaks escalates.

## Reasons Behind the Declining Vaccination Rates?

The CDC’s examination did not delve into the specifics of the reasons underpinning the declining vaccination rates, but experts hypothesize that various elements might be influencing this trend. One possibility