Data Engineer II
Allen, Texas, UNITED STATES; Birmingham, Alabama, UNITED STATES; Branson, Missouri, UNITED STATES; Elizabethtown, Kentucky, UNITED STATES; Louisville, Kentucky, UNITED STATES; Springfield, Missouri, UNITED STATES; Troy, Michigan, UNITED STATES
R
USD 56K-89K (estimate) Mid-level Full Time
Tasks
- Create CI/CD pipelines
- Create technical documentation and runbooks
- Design data integration solutions
- Develop data pipelines (batch and streaming)
- Implement event-driven architectures
- Implement monitoring logging alerting and observability
- Maintain data pipelines
- Maintain enterprise data warehouse and lakehouse solutions
- Modernize legacy data integration solutions
- Optimize pipeline throughput scalability resiliency and cost
- Participate in code reviews and pull request workflows
- Provide on-call and after-hours support
- Test and deploy data pipelines
- Tune SQL queries for performance
Perks/Benefits
Skills/Tech-stack
Alerting | Apache Iceberg | C# | CI/CD | Change Data Capture | Data Capture | Delta Lake | Docker | ELT | ETL | Git | Hudi | Kafka | Kubernetes | Logging | Messaging | Monitoring | MySQL | Observability | Parquet | Powershell | Python | SQL | SQL Server | Terraform
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R26d ago
-
Anomaly Detection | Data Engineering | Data Lakes | Data Pipelines | Data ProcessingRegular team sessions | Remote friendly schedule | Team collaborationSenior-level Full TimeRemote, Canada (EST); San Francisco, California R5h ago
-
Aerospike | Ansible | Capacity Planning | Ceph | Configuration ManagementSenior-level Full TimeRemote, Canada; Toronto, Ontario; San Francisco, … R5h ago
-
Data Analysis | Data pipeline | Machine Learning | Multimodal Learning | PythonMid-level Full TimeSan Francisco, California; Toronto, Canada; Redwood … R5h ago
-
Active Learning | Adaptive Sampling | Deep learning | Direct Preference Optimization | Human FeedbackMid-level Full TimeSan Francisco, California; Remote, US or … R5h ago
-
Agile | Cloud Storage | Google Cloud | Google Cloud Storage | GraphQLMid-level Full TimeSan Francisco, California; Remote, Canada, US, … R5h ago
-
Artificial Intelligence | Cloud Computing | Data integration | Generative AI | High AvailabilityMid-level Full TimeNew York City, NY; Toronto, Ontario; … R5h ago
-
AWS | AWS Bedrock | AWS CDK | Anthropic | CelerySenior-level Full TimeKitchener, Ontario; Remote, Canada; Remote, Canada; … R5h ago
-
AWS | Azure | Data Analysis | Data Visualization | Deep learningMid-level Full TimeRemote, Canada; San Francisco, California; Toronto, … R5h ago
-
Data Curation | Experimentation | MLOps | Machine Learning | Machine learning modelingSenior-level Full TimeToronto, Canada; Remote, Canada; Kitchener, Ontario; … R5h ago
-
Data Warehousing | Deep learning | Experimentation | Infrastructure | LLMSenior-level Full TimeRemote, Canada or US; Remote, Canada … R5h ago
-
Senior-level Full TimeCanada or US, N/A; Toronto, Ontario; … R5h ago
-
AWS | Azure | Data Annotation | Data Pipelines | Docker100% remote in Quebec | AI coding tool subscription | Bilingual support | Travel up to 25 percentMid-level Full TimeMontreal or Quebec City, Quebec; Toronto, … R5h ago
-
Anomaly Detection | Classification | Clustering | Data Modeling | Data PipelinesHealth benefits | Hybrid work arrangement | Paid time off | Professional developmentSenior-level Full TimeToronto, Ontario; Kitchener, Ontario; The Valley, … R5h ago
-
AWS Data | AWS Data Lakes | Amazon Web Services | Apache Spark | Data AnalysisFlexible work schedule | Hybrid work modelSenior-level Full TimeToronto, Ontario; Remote, Canada; Toronto, Ontario; … R5h ago
-
AWS | Agentic AI | Agile | Amazon Bedrock | Apache AirflowSenior-level Full TimeToronto, Ontario; New York, USA; Bay … R5h ago
-
Data Architect / Analytics Engineer (Databricks) USD 175K-248KAWS Redshift | Azure Synapse | Data Modeling | Data Warehousing | DatabricksRemote workSenior-level Full TimeUSA, Remote; USA, Remote R5h ago
-
API | Amazon Web Services | Amazon Web Services (AWS) | Apache HDFS | Apache SparkRemote workMid-level Full TimeRemote, US; Sunnyvale, CA; Dallas, TX R6h ago
-
Airflow | C++ | Data Pipelines | Distributed Computing | ElasticsearchSenior-level Full TimeSunnyvale, CA; Palo Alto, CA; St. … R6h ago
-
Airflow | C++ | Data Pipelines | Distributed Computing | ElasticsearchSenior-level Full TimeSunnyvale, CA; Burr Ridge Chicago, IL; … R6h ago
-
Senior-level Full TimeSunnyvale, CA; Palo Alto, CA; St. … R6h ago
-
Apache Kafka | Apache Maven | Apache Spark | Apache Storm | Cloud platformMid-level Full TimeSunnyvale, CA; Palo Alto, CA; St. … R6h ago
-
Apache Kafka | Apache Spark | Azure SQL | Cassandra | Continuous DeploymentEntry-level Full TimeSunnyvale, CA; Palo Alto, CA; St. … R6h ago
-
Akka | Akka Streams | Akka-http | Apache Camel | Apache DroolsSenior-level Full TimeSunnyvale, CA; Remote, USA; Remote, Onshore … R6h ago
-
Azure Database Engineer (Hybrid - St. Paul, MN) USD 123K-155KAccess Control | Azure Backup | Azure CLI | Azure Data | Azure Data FactoryHybrid workSenior-level Full TimeSt Paul, Minnesota R6h ago