Senior Data Engineer
Tasks
- Build data cataloging and lineage tracking
- Build real-time data pipelines
- Contribute to CI/CD pipeline design
- Create automated testing for data pipelines
- Design data architectures
- Design scalable batch data pipelines
- Develop ETL/ELT workflows
- Develop cloud data integration solutions
- Implement data quality validation
- Implement infrastructure automation for deployments
- Implement metadata management
- Maintain technical documentation
- Monitor and optimize ETL processes
- Participate in Agile/Scrum delivery
Perks/Benefits
Skills/Tech-stack
AWS Glue | Agile | Airflow | Amazon Redshift | Apache Spark | Azure Data | Azure Data Factory | Azure DevOps | Azure Synapse | Azure Synapse Analytics | BigQuery | CI/CD | Cassandra | Cloud platform | Data Factory | Data Lakes | Data Warehousing | Databricks | Dimensional Modeling | Docker | ELT | ETL | Git | GitHub Actions | Google Cloud | Google Cloud Platform | Infrastructure automation | Java | Jenkins | Kafka | Kubernetes | MongoDB | MySQL | Oracle | PostgreSQL | Python | Release Management | SQL | SQL Server | Scala | Scrum | Snowflake | Snowflake Schema | Star Schema | Streaming | Synapse Analytics | Terraform
Education
Bachelor of Engineering | Bachelor of Science | Bachelor of Science in Computer Science | Bachelor of Science in Information Technology | Bachelor of Science in Mathematics
Roles
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R7d ago
-
Senior-level Full TimeSunnyvale, CA | Remote, US | … R8h ago
-
Software Engineer, Machine Learning USD 213K-251KAlgorithms | Data Structures | Graph theory | Information Retrieval | Language ProcessingSenior-level Full TimeSunnyvale, CA | Los Angeles, CA … R8h ago
-
Senior-level Full TimeRemote, US | Bellevue, WA | … R8h ago
-
Staff Data Scientist - Digital Intelligence USD 191K-230KAdversarial Modeling | Anomaly Detection | Apache Spark | Data Processing | Distributed dataSenior-level Full TimeHybrid - US R14h ago
-
Data Scientist ll - Digital Intelligence USD 140K-170KDatabricks | Experiment analysis | Feature Engineering | Machine Learning | Model EvaluationMid-level Full TimeHybrid - US R16h ago
-
Senior Data Engineer, Platform USD 119K-149KAWS DMS | Access Control | Airflow | Amazon Web Services | CI/CDSenior-level Full TimeRemote - US, United States R19h ago
-
Edge AI Engineer USD 100K-155KC++ | Core ML | Cross Platform Inference | Cross-platform | Edge inferenceSenior-level Full TimeUnited States - Remote R19h ago
-
Full Stack AI Engineer USD 140K-170KAWS | Agent workflows | Anthropic | Azure | CI/CD401k matching | Birthday off | Employee assistance program | Medical/Dental/Vision insurance | Paid parental leaveSenior-level Full TimeRemote South Carolina, Remote South Carolina, … R19h ago
-
Senior-level Full TimeUnited States - Remote R19h ago
-
AI Research Engineer USD 100K-150KAccelerator hardware | Agentic Systems | Computer Vision | Data Quality | Data labelingCareer growth | Remote workSenior-level Full TimeUnited States - Remote R19h ago
-
Hadoop Big Data Developer USD 100K-150KAWS EMR | Airflow | Apache Atlas | Apache Flink | Apache HudiRemote workSenior-level Full TimeUnited States - Remote R19h ago
-
Hadoop Big Data Developer USD 100K-150KAirflow | Apache Flink | Apache Hive | Apache Pig | Apache SparkCareer growth | Remote workSenior-level Full TimeUnited States - Remote R19h ago
-
Senior-level Full TimeUnited States - Remote R19h ago
-
Backend AI-Forward Data Engineer USD 100K-125KAWS | Airflow | Anomaly Detection | Automated testing | Azure DataDental insurance | Disability insurance | Health insurance | Life insurance | Paid HolidaysSenior-level Full TimeRemote South Carolina, Remote South Carolina, … R19h ago
-
Batch Processing | Confluence | Data Pipelines | Data Quality | Data ValidationHybrid work schedule | Remote work considerationSenior-level Full TimeOhio - Columbus, Three Nationwide Plaza, … R19h ago
-
LLM Engineer USD 100K-150KAdapter-Tuning | DPO | Dataset curation | DeepSpeed ZeRO | Efficient AttentionCareer growth | Remote workMid-level Full TimeUnited States - Remote R19h ago
-
Data Engineer USD 120K-150KAPIs | Access Control | Airbyte | Amazon Redshift | Apache AirflowFully remote | Work independentlyMid-level Full TimeUnited States (Remote) R20h ago
-
Senior Software Engineer (Applied AI) USD 160K-200KAPIs | AWS | Agentic Workflows | Best practices | Cost monitoringCareer development | Discretionary performance bonus | Equity options | Health benefitsSenior-level Full TimeSeattle, New York City, Boston, or … R22h ago
-
Staff Data Platform Engineer USD 213K-245KAWS | AWS Lambda | CDK | CI/CD | Code Quality401k match | Catered lunches | Dental insurance | Flexible work schedule | HackathonsSenior-level Full TimeRemote, United States R22h ago
-
Senior Software Engineer, Perception Architecture USD 184K-296KC++ | Computer Vision | Data pipeline | Deep learning | Machine LearningSenior-level Full TimePittsburgh, PA or Remote R22h ago
-
Senior Software Engineer, Data & AI Platform USD 171K-224KApache Spark | Batch Processing | CI/CD | Cloud Native | Data Engineering401k retirement savings plan | Annual cash bonus | Equity grants | Flexible time off | Generous parental leaveSenior-level Full TimeRemote, USA R23h ago
-
Staff Machine Learning Engineer USD 118K-136KCI/CD | Data Governance | Data Modeling | Data Pipelines | Data Quality401k match | Dental insurance | Family planning resources | Flexible vacation policy | Fully remoteSenior-level Full TimeRemote - USA R23h ago
-
Associate Machine Learning AI Engineer USD 100K-138KAPI Design | API Key | API key management | AWS | Agent workflowsHealth insurance | Remote work option | Unlimited Paid Days OffMid-level Full TimeRemote - United States R1d ago
-
Principal Cloud Database Engineer USD 115K-192KAI machine learning | Alerting | AlloyDB | Anomaly Detection | Backup & RecoveryEmployee resource groups | Flexible family care | Medical Dental Prescription Drug Coverage | Option to purchase additional vacation time | Paid HolidaysSenior-level Full TimeMI, United States R1d ago