Remove Government Remove Software Development Remove Software Engineering
article thumbnail

The Convergence of Data & Software Engineering in the Age of AI

Tom Tunguz

Data contracts express the commitments data teams make to others in the company about data freshness, format, & consistency - again drawing parallels to the service-level agreements in core engineering. Security systems govern access to databases akin to secrets management & identity access management solutions do in the cloud.

article thumbnail

Top 10 Trends for Data in 2024

Tom Tunguz

Data Teams are Becoming Software Teams : DevOps created a movement within software development that empowers developers to run the software they wrote. Most sophisticated data teams run like software engineering teams with product requirement documents, ticketing systems, & sprints.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Top Themes in Data Transcript

Tom Tunguz

He says the IT department of the future will be like the HR department for AI agents We’ll be managing and ’training’ these agents to work with our data Transition: This change starts first within the engineering org Slide 9 Clearing: Historically, there’s been a divide between software engineering and AI/ML teams.

Data 100
article thumbnail

Tabular: Turning Your Data Swamp into a Data Lakehouse with Apache Iceberg

Clouded Judgement

Data Lakehouses provide the crucial piece of infrastructure for foundation models to securely and efficiently access both structured and unstructured data with governance intelligently wrapped around it. Just terrible performance…), (3) there’s no real security / governance, and (4) data quality controls don’t exist.

Data 130