IT Data Engineer
Tasks
- Build data pipelines and data workflows
- Build scalable storage layers
- Create dashboards and data visualizations
- Develop and optimize PySpark notebooks
- Document data sources definitions and lineage
- Ensure data quality, reliability, and performance
- Ingest data into data lake and warehouse
- Monitor pipeline performance and troubleshoot failures
- Recommend and implement process enhancements
- Translate business requirements into data models and designs
Perks/Benefits
- 401k match
- Flexible spending accounts
- Health savings account
- Medical/Dental/Vision insurance
- Paid Holidays
- Paid parental leave
- Paid sick days
- Paid vacation
- Training & development
- Tuition reimbursement
- Wellness program
Skills/Tech-stack
Alation | Azure | Azure Data | Azure Data Factory | Azure Data Lake | Azure Synapse | Data Factory | Data Governance | Data Lake | Data Lineage | Data Modeling | Data Partitioning | Data Quality | Data Warehousing | Data orchestration | Databricks | Dataflows | Delta Lake | ELT | ELT pipelines | ETL | ETL/ELT | ETL/ELT pipelines | Lakehouse | Microsoft Fabric | Parquet | Power BI | PySpark | Python | SQL
Education
Roles
Related jobs
-
Algebra | DCS | Data Historians | Data Preprocessing | Data Visualization401k match | Childbearing leave | Dental insurance | Disability insurance | Life insuranceMid-level Part TimeAtlanta, GA, United States16h ago
-
Computer Scientist II USD 110K-140KAgile | Angular | Azure DevOps | C# | CI/CD401k employer match | Dental insurance | Disability insurance | Flexible spending account | Health insuranceMid-level Full TimeLas Vegas, NV, United States16h ago
-
Management Systems Computer Scientist I USD 123K-140KAmazon Aurora | Amazon DynamoDB | Amazon RDS | Amazon Web Services | Azure SQL401k plan | Dental insurance | Disability insurance | Health insurance | Health savings accountMid-level Full TimeEdwards AFB, CA, United States16h ago
-
AWS Glue | AWS IAM | AWS Lambda | Amazon CloudWatch | Amazon EC2100 percent onsite | Onsite in McLean VASenior-level ContractMc Lean, United States19h ago
-
Senior-level ContractAustin, United States20h ago
-
Data Engineer ID50062 USD 148K-164KAWS | AWS SageMaker | AWS SageMaker Studio | Airflow | AvroFlexible schedule | Mentorship | Office options | Personalized growth roadmaps | Remote work optionsSenior-level Full TimeAustin, United States20h ago
-
Data Engineer ID50062 USD 148K-164KAWS | Airflow | Apache Spark | Avro | DuckDBFlextime | Mentorship | Office options | Personalized growth roadmaps | Remote work optionsSenior-level Full TimeWest Palm Beach, United States20h ago
-
Data Engineer ID50062 USD 148K-164KAWS | Advanced Analytics | Airflow | Apache Spark | AvroFlexible schedule | Mentorship | Office options | Remote work options | TechtalksSenior-level Full TimeJacksonville, United States20h ago
-
Data Engineer ID50062 USD 148K-164KAWS | Apache Airflow | Apache Spark | Avro | Columnar StorageFlexible schedule | Mentorship | Personalized growth roadmap | Remote work options | TechtalksSenior-level Full TimeHouston, United States20h ago
-
Data Engineer - TechCare Operations: Blueprint team USD 103K-174KAgile | DBMS | Data Architecture | Data Modeling | Database AdministrationCareer development and training | Company 401k match | Disability benefits | Employee counseling support | Financial coachingSenior-level Full TimeUS-Arizona-Phoenix20h ago
-
Senior AI Engineer USD 123K-215KAPI Design | API Versioning | AWS | Argo Workflows | Authentication & AuthorizationCareer development and training | Confidential counseling support | Employee wellness centers | Financial coaching | Health insuranceSenior-level Full TimeUS-Arizona-Phoenix20h ago
-
Data Engineer USD 117K-195KAWS | Cloud Security | Cloud infrastructure | Data Governance | Data LakesHealth insurance | Holiday pay | Learning and development | Life insurance | Long-term disabilitySenior-level Full TimeUSA-Remote Work R21h ago
-
Senior Software Engineer, Full Stack - USDS USD 150K-180KAI tools | Agent workflows | Code Quality | Debugging | JavaScriptSenior-level Full TimeSan Jose, California, United States21h ago
-
Research Engineer, Language USD 170K-251KData Processing | Deep learning | Distributed Systems | Efficient Inference | Efficient TrainingEntry-level Full TimeBurlingame, CA22h ago
-
Software Engineer, AI/ML, Geo Data Protection USD 147K-211KC++ | Data Processing | Debugging | Distributed Computing | Information RetrievalMid-level Full TimeMountain View, CA, USA22h ago
-
Software Engineer, AI/ML, Google Ads USD 174K-252KC plus plus | Data Processing | Data Storage | Data Structures | Data Structures and AlgorithmsMid-level Full TimeMountain View, CA, USA22h ago
-
Senior Software Engineer, Compiler Optimization USD 174K-252KC# | C++ | Compiler optimization | Data Analysis | Data StructuresSenior-level Full TimeSunnyvale, CA, USA22h ago
-
Software Engineer III, AI/ML, Display Ads USD 147K-211KC++ | Data Analysis | Data Processing | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeMountain View, CA, USA22h ago
-
Staff Software Engineer USD 207K-300KArtificial Intelligence | C++ | Computer Vision | Data Processing | Embedding ModelsSenior-level Full TimeMountain View, CA, USA22h ago
-
Application development | C++ | Data Analysis | Data Processing | Data Processing PipelinesMid-level Full TimeSunnyvale, CA, USA22h ago
-
Senior Software Engineer, AI/ML, Google Cloud AI USD 174K-252KC++ | Code review | Data Processing | Debugging | Distributed ComputingSenior-level Full TimeSunnyvale, CA, USA22h ago
-
Senior Software Engineer, AI/ML GenAI, Google Play USD 174K-252KAlgorithms | C++ | Computer Vision | Data Processing | Data StructuresSenior-level Full TimeMountain View, CA, USA22h ago
-
Software Engineer III, AI/ML GenAI, Google Cloud Compute USD 147K-211KAudio generation | C++ | Data Processing | Debugging | Distributed ComputingSenior-level Full TimeKirkland, WA, USA22h ago
-
Senior-level Full TimeBoston, MA1d ago
-
Staff Engineer, Data Migration USD 151K-297KDebezium | Java | JavaScript | Kafka | MySQL401k | Fertility and adoption assistance | Flexible paid time off | Health benefits | Mental health counselingSenior-level Full TimeCalifornia; Oregon; Washington1d ago