Senior Data Engineer
USD 119K-165K (estimate) Senior-level Full Time
Tasks
- Automate data pipelines
- Build Azure Databricks PySpark pipelines
- Build DB objects
- Collaborate with data analysts and developers
- Create ETL processes
- Create stored procedures
- Design DataOps workflows
- Design data architecture
- Design data governance compliant solutions
- Design reusable metadata driven ingestion frameworks
- Develop data pipelines
- Ensure data security compliance
- Implement Continuous Integration pipelines
- Implement Delta Lake medallion models
- Implement ETL workflows
- Improve data quality
- Lead engineering communities of practice
- Maintain data pipelines
- Manage version control branching and releases
- Mentor data team members
- Optimize data pipelines
- Troubleshoot data extract and load jobs
- Write complex T-SQL queries
Perks/Benefits
- N/A
Skills/Tech-stack
Azure Data | Azure Data Factory | Azure Databricks | Azure DevOps | Azure Functions | Azure Key Vault | Azure Logic | Azure Logic Apps | C# | CI/CD | Common table expressions | Continuous integration | DDL | DML | DWH Architecture | Data Factory | Data Governance | Data Security | DataOps | Delta Lake | ETL | Git | Jenkins | Key Vault | Logic Apps | Medallion Architecture | Powershell | PySpark | Query Tuning | SQL | SQL Server | Stored Procedures | T-SQL | Triggers | Version control
Education
Bachelor of Engineering | Bachelor of Science | Master of Science | PhD
Roles
Related jobs
-
AI Gateways | AWS CDK | Chunking | Context engineering | Cost Tracking401k match | Counseling membership | Flexible time away | Life insurance | Long-term disabilityMid-level Full Time-REMOTE, USA- R17h ago
-
Agile | Apache Airflow | Artificial Intelligence | Automated testing | BigQueryCollaborative culture | Flexible working hours | Performance evaluations | Professional development opportunities | Remote workSenior-level Full TimeIdaho R1d ago
-
Agile | Apache Airflow | BigQuery | CI/CD | Cloud StorageCollaborative company culture | Flexible working hours | Professional development opportunities | Remote-first work environmentSenior-level Full TimeMinnesota R1d ago
-
Agile | Airflow | BigQuery | CI/CD | Cloud StorageCollaborative culture | Professional development | Remote-first flexibilitySenior-level Full TimeColorado R1d ago
-
Agile | Airflow | BigQuery | CI/CD | Cloud StorageCollaborative company culture | Flexible working hours | Professional development opportunities | Remote-first environmentSenior-level Full TimeColumbia R1d ago
-
Agile | Airflow | Automated testing | BI tools | BigQueryCollaborative company culture | Professional development | Remote-first flexible hoursSenior-level Full TimeIllinois R1d ago
-
Agile | Airflow | BigQuery | CI/CD | Cloud StorageCollaborative company culture | Professional development opportunities | Remote-first flexible hoursSenior-level Full TimeFlorida R1d ago
-
Agile | Airflow | Automated testing | BI tools | BigQueryCollaborative culture | Flexible working hours | Professional development | Remote-first environmentSenior-level Full TimeCalifornia R1d ago
-
Agile | Apache Airflow | Automated testing | BigQuery | CI/CDCollaborative company culture | Professional development opportunities | Remote-first flexibilitySenior-level Full TimeConnecticut R1d ago
-
Agile | Airflow | BI tools | BigQuery | CI/CDCollaborative & Innovative Culture | Professional development | Remote-first flexible hoursSenior-level Full TimeArizona R1d ago
-
Apache Airflow | Apache Hive | Apache Iceberg | Apache Kafka | Apache SparkFully remote work option | International hiring | Long term contractor optionEntry-level Full TimeUnited States R1d ago
-
Data Integrity | Data Mapping | Data Migration | Data Transformation | Data Validation401k | Career development | Certifications and training | Dental insurance | HolidaysSenior-level Full TimeWashington, District of Columbia, United States … R1d ago
-
ML Infrastructure Engineer USD 145K-165KAWS | Amazon Elastic Kubernetes Service | Amazon SageMaker | BigQuery | CD pipelinesHealth benefits | Paid time off | Remote work optionMid-level Full TimeBoston, MA R2d ago
-
ML Infrastructure Engineer USD 145K-165KAWS | Amazon SageMaker | BigQuery | CI/CD | CloudFormationBenefits plans | Remote work optionMid-level Full TimeNew York, New York, United States R2d ago
-
ML Infrastructure Engineer USD 145K-165KAWS | Amazon SageMaker | BigQuery | BigQuery datasets | CI/CDCompany benefits plan enrollment | Health benefits | Performance-based bonus | Remote work optionMid-level Full TimeLos Angeles, California, United States R2d ago
-
C# | MATLAB | NumPy | Pandas | PythonFlexible hours | Non permanent employment | Part-time project workSenior-level Full TimeNew York, New York, United States … R2d ago
-
Senior Python Developer - Code Migration Specialist USD 160K-160KBash | Coverage.py | Dagger | Docker | GcovFlexible schedule | Freelance project-based collaboration | Fully remote | Supportive global communitySenior-level Full TimeNew York, United States - Remote R2d ago
-
Senior Python Developer - Code Migration Specialist USD 160K-160KBash | Black box testing | Black-box | Box testing | Code CoverageFlexible schedule | Project-based collaboration | Remote work | Supportive global communitySenior-level Full TimeTexas, United States - Remote R2d ago
-
Senior Python Developer - Code Migration Specialist USD 160K-160KBash | Black box testing | Black-box | Box testing | Code CoverageFlexible hours | Fully remote | Project-based collaboration | Supportive communitySenior-level Full TimeMichigan, United States - Remote R2d ago
-
Senior Python Developer - Code Migration Specialist USD 160K-160KBash | Coverage.py | Dagger | Docker | GcovFlexible schedule | Freelance project-based collaboration | Fully remote | Opportunity to contribute to AI projects | Supportive global communitySenior-level Full TimeUnited States - Remote R2d ago
-
Senior AI Data Engineer USD 160K-200KAWS | AWS Athena | AWS Glue | AWS Lambda | Amazon Redshift401k matching | Dental insurance | Disability insurance | Life insurance | Medical insuranceSenior-level Full TimeSan Diego, California, United States R2d ago
-
Causal Inference | Classification | Clustering | Data Warehousing | Experiment designFlexible PTO | Home office stipend | Learning budget | Paid health, dental, vision | Parental leaveSenior-level Full TimeBoston or Remote R2d ago
-
Senior Data Engineer USD 155K-220KAPI Integration | Alerting | Amazon Redshift | Automated testing | CI/CDSenior-level Full TimeDenver, CO;San Francisco, CA;New York, NY;Los … R2d ago
-
Data Engineer USD 74K-133KAgile | Apache Airflow | BigQuery | Cloud Composer | Cloud Storage401k employer match | Dental insurance | Disability insurance | Flexible time off | Health insuranceMid-level Full TimeLisle, IL, United States R2d ago
-
Lead Instructor: MLOps / AI Platform Engineering USD 23K-27KAI Foundry | Azure AI | Azure AI Foundry | Azure Machine Learning | CI/CDFlexible scheduling | Professional training delivery | Remote workSenior-level Full TimeU.S. Remote R2d ago