IT Data Engineer
Tasks
- Build data pipelines and data workflows
- Build scalable storage layers
- Create dashboards and data visualizations
- Develop and optimize PySpark notebooks
- Document data sources definitions and lineage
- Ensure data quality, reliability, and performance
- Ingest data into data lake and warehouse
- Monitor pipeline performance and troubleshoot failures
- Recommend and implement process enhancements
- Translate business requirements into data models and designs
Perks/Benefits
- 401k match
- Flexible spending accounts
- Health savings account
- Medical/Dental/Vision insurance
- Paid Holidays
- Paid parental leave
- Paid sick days
- Paid vacation
- Training & development
- Tuition reimbursement
- Wellness program
Skills/Tech-stack
Alation | Azure | Azure Data | Azure Data Factory | Azure Data Lake | Azure Synapse | Data Factory | Data Governance | Data Lake | Data Lineage | Data Modeling | Data Partitioning | Data Quality | Data Warehousing | Data orchestration | Databricks | Dataflows | Delta Lake | ELT | ELT pipelines | ETL | ETL/ELT | ETL/ELT pipelines | Lakehouse | Microsoft Fabric | Parquet | Power BI | PySpark | Python | SQL
Education
Roles
Related jobs
-
Lead Data Engineer – Azure Databricks USD 150K-180KARIMA | Azure Databricks | Data Processing | Data analytics | Machine LearningOnsite workSenior-level Full TimeTampa, United States3h ago
-
HR Analytics & Technology Engineer USD 110K-204KAlteryx | Artificial Intelligence | Data Governance | Data Modeling | Data Quality401k matching | Generous time off | Onsite fitness center | Tuition reimbursementSenior-level Full TimeUS-Rhode Island-Providence4h ago
-
Cause analysis | Cloud Computing | Data Enrichment | Data Monitoring | Data Processing401k match | Dental insurance | Health insurance | Life insurance | Paid HolidaysSenior-level Full TimeNew York4h ago
-
Deloitte Technology - US Associate GenAI Engineer USD 80K-100K.Net Core | AWS | Agile | Angular | AzureMid-level Full TimeHermitage, Tennessee, United States4h ago
-
Senior-level Full TimeDallas, Texas, United States4h ago
-
Infra Engineer- US USD 120K-150KAWS | Amazon IAM | Azure | Cloud Cost Optimization | Cloud SecurityMid-level Full TimeNew York City, NY, US5h ago
-
As-a-Service | C++ | Cloud Functions | Cloud platform | Compute TechnologiesSenior-level Full TimeSunnyvale, CA, USA5h ago
-
Research Engineer, Gemini Latent Thinking, DeepMind USD 207K-300KAblation Study | Algorithm Development | Deep learning | Experiment design | Language ModelsSenior-level Full TimeCambridge, MA, USA; Mountain View, CA, …5h ago
-
Manufacturing Test Engineer, Data Center USD 120K-172KBSCAN | Bash | Bring-up | Calibration | Correlation studyMid-level Full TimeAtlanta, GA, USA6h ago
-
Software Engineer, Compiling, Quantum AI USD 147K-211KC++ | Classical coding theory | Coding theory | Compiler architecture | CompilersMid-level Full TimeMountain View, CA, USA; Los Angeles, …6h ago
-
Research Scientist, Robotics, Embodied AI, DeepMind USD 147K-211KDeep learning | Language Models | Machine Learning | Python | Reinforcement LearningSenior-level Full TimeMountain View, CA, USA6h ago
-
Software Engineer, Decoding, Quantum AI USD 147K-211KC++ | Concurrency | Device Driver Development | Device driver | Driver DevelopmentMid-level Full TimeLos Angeles, CA, USA; Goleta, CA, …6h ago
-
C# | C++ | Co-design | Compiler technology | Computer ArchitectureSenior-level Full TimeSunnyvale, CA, USA6h ago
-
Kinetic Machine Learning Engineer USD 90K-123KClustering | Data Quality | Data quality profiling | Drift monitoring | Ensemble learning401k | Dental insurance | Educational assistance | Flexible savings account | Health savings accountMid-level Full TimeUnited States7h ago
-
AWS S3 | Almabase | Amazon Athena | Azure Data | Azure Data LakeMid-level Full TimeRemote within Texas, TX, US R8h ago
-
ALB | ALB/NLB | AWS | AWS CDK | AWS CloudSenior-level Full TimeDallas, Texas, United States14h ago
-
Statistics & Python Expert - Freelance AI Trainer USD 146K-146KCombinatorics | Graph theory | MATLAB | NumPy | Number theoryFlexible hours | Freelance opportunities | Project based workSenior-level FreelanceNew York, New York, United States … R17h ago
-
Statistics & Python Expert - Freelance AI Trainer USD 146K-146KCombinatorics | Graph theory | Mathematics | NumPy | Number theoryFreelance opportunity | Part-time project-based workSenior-level FreelanceFlorida, United States - Remote R17h ago
-
Statistics & Python Expert - Freelance AI Trainer USD 146K-146KC# | Combinatorics | Graph theory | MATLAB | NumPyFlexible hours | Part-time opportunities | Project based workSenior-level FreelanceTexas, United States - Remote R17h ago
-
Statistics & Python Expert - Freelance AI Trainer USD 146K-146KC# | MATLAB | NumPy | Pandas | PythonPart-time availability | Project based workSenior-level FreelanceMichigan, United States - Remote R17h ago
-
Technical Architect - Machine Learning USD 165K-200KAKS | AWS | Async Programming | Autogen | AzureSenior-level Full TimeUSA - Remote, United States R17h ago
-
Mid-level ContractPhoenix, AZ17h ago
-
Lead AI Engineer (Gen AI Platform Services) USD 215K-245KAWS | AWS Ultraclusters | Azure | C# | C++Senior-level Full TimeSan Jose, CA, United States17h ago
-
Lead Software Engineer – Robotics Platform USD 224K-431KC++ | CUDA | Distributed tracing | Embedded Systems | Isaac SimEquity | Health and wellness benefits | Paid time offSenior-level Full TimeUS, CA, Santa Clara, United States17h ago
-
Software Engineer I/II, Machine Learning USD 129K-190KAWS | Amazon S3 | Apache Airflow | Apache Arrow | CI/CD401k matching | Flexible spending account | Health insurance | Hybrid work | Life insuranceMid-level Full TimeBoston Office18h ago