Is AI coming for me? › IT & software
Is AI coming for me?
Data engineer
Also called: ETL developer, Data platform engineer
AI writes the pipeline. You still have to find out why the source data lies.
Medium risk
45% of the work AI can already do
When it hits: 2–5 years
Your job will change
Code assistants now generate much of the SQL, dbt models and pipeline boilerplate that used to fill a data engineer's week. The hard part is still messy source systems, undocumented business logic and keeping pipelines reliable and governed. Fewer engineers will be needed per pipeline but demand for data feeding AI projects is rising.
What AI will take
- Writing SQL transformations and dbt models
- Generating pipeline and orchestration boilerplate
- Writing data quality tests and documentation
- Converting code between platforms and dialects
- Basic schema mapping between sources
What stays human
- Untangling undocumented legacy source systems
- Designing data architecture that will survive the next reorg
- Agreeing data definitions across departments that disagree
- Owning reliability when the overnight load fails
- Data governance, lineage and privacy decisions
How to adapt and stay ahead
- Move up to data platform architecture and design
- Learn the data plumbing behind AI: retrieval, vector stores and evaluation pipelines
- Build deep knowledge of one industry's data, such as health, energy or banking