Data Engineer
Tasks
- Build AI-ready data pipelines
- Design distributed data processing pipelines
- Develop streaming architectures for real time ingestion
- Enable data lineage and metadata management
- Ensure data pipelines meet security and DevSecOps practices
- Implement enterprise data layer with metadata management
- Integrate Spark Kafka Trino ClickHouse Iceberg and OpenSearch
- Monitor observability and ensure scalable software delivery
- Support multi source data fusion for analytics
- Transform and ingest batch and streaming data
Perks/Benefits
Skills/Tech-stack
AI Ready | AI-Ready Data | AI-ready data pipelines | ClickHouse | Cybersecurity | Data Fusion | Data Ingestion | Data Lineage | Data Pipelines | Data Processing | Data Transformation | Data pipeline | DevSecOps | Distributed data | Distributed data processing | Iceberg | Kafka | Metadata Management | Multi Source Data Fusion | Multi-source data | OpenSearch | Spark | Streaming Data | Trino
Education
N/A
Roles
Related jobs
-
Click Through Rate | Click Through Rate Prediction | Conversion Rate | Conversion Rate Prediction | Data AnalysisSenior-level Full TimeSeattle, Washington, United States10h ago
-
Machine Learning Engineer, Recommendation - E-Commerce USD 145K-337KClick Through Rate | Click Through Rate Modeling | Computer Vision | Conversion Rate | Conversion rate modelingSenior-level Full TimeSan Jose, California, United States10h ago
-
A/B | A/B Testing | B testing | Big Data | Data TransformationSenior-level Full TimeSan Jose, California, United States10h ago
-
Senior Software Development Engineer - Data USD 156K-338KBig Data | Data Engineering | Data Transformation | Reliability | ScalabilitySenior-level Full TimeSan Jose, California, United States10h ago
-
Data Engineer, Global Live USD 145K-250KData Modeling | Data Warehousing | Data discovery | Data integration | Data pipelineMid-level Full TimeSan Jose, California, United States10h ago
-
Data Engineer, E-Commerce USD 118K-185KBig Data | Data Pipelines | Data Transformation | ScalabilityMid-level Full TimeSeattle, Washington, United States10h ago
-
Benchmarking | Causal Inference | Data Mining | Data Pipelines | Data PreprocessingMid-level Full TimeSeattle, Washington, United States10h ago
-
Benchmarking | Causal Inference | Data Mining | Data Pipelines | Data PreprocessingMid-level Full TimeSan Jose, California, United States10h ago
-
Machine Learning Engineer, Ecommerce Risk Control USD 175K-266KData Analysis | Data Pipelines | Data Visualization | Deep learning | Experiment designSenior-level Full TimeSeattle, Washington, United States10h ago
-
Causal Inference | Data Mining | Data Pipelines | Data Preprocessing | EmbeddingsSenior-level Full TimeSeattle, Washington, United States10h ago
-
Machine Learning Engineer - Demand Forecasting (TikTok Global E-commerce Supply Chain and Logistics) USD 136K-205KAnomaly Detection | Causal Inference | Data Analysis | Data Mining | Data PipelinesSenior-level Full TimeSan Jose, California, United States10h ago
-
Machine Learning Engineer - Demand Forecasting (TikTok Global E-commerce Supply Chain and Logistics) USD 136K-205KAnomaly Detection | Causal Inference | Data Analysis | Data Mining | Data PipelinesSenior-level Full TimeSeattle, Washington, United States10h ago
-
Machine Learning Engineer - E-commerce Recommendation USD 122K-237KClick Through Rate | Click Through Rate Prediction | Conversion Rate | Conversion Rate Prediction | Data AnalysisEntry-level Full TimeSan Jose, California, United States10h ago
-
Machine Learning Engineer - E-commerce Recommendation USD 122K-237KClick Through Rate | Click Through Rate Prediction | Conversion Rate | Conversion Rate Prediction | Data PipelinesEntry-level Full TimeSeattle, Washington, United States10h ago
-
Senior Data Engineer USD 115K-150KAWS | AWS Glue | Airflow | Amazon Redshift | Amazon S3401k contribution | Health insurance | Life insuranceSenior-level Full TimeWashington, DC17h ago
-
Senior Staff AI Data Engineer - Hybrid USD 135K-202KAWS | Alerting | Azure | Batch pipelines | ChunkingHybrid work schedule | Learning and development opportunities | MentorshipSenior-level Full TimeHartford CT- Home Office, United States R22h ago
-
Mid-level Full TimeUnited States - Remote R22h ago
-
Senior Machine Learning Engineer USD 112K-183KAWS | Data Ingestion | Data Modeling | Data Quality | Data Visualization401k savings plan | Adoption benefits | Career development | Disability benefits | Employee assistance programSenior-level Full TimeMossville, Illinois, United States22h ago
-
Mid-level Full TimeChildren's Healthcare of Atlanta Support Center, …22h ago
-
Lead, Financial Crime Data Science & Data Engineering USD 108K-171KAML Compliance | BSA/AML | Batch Processing | Credit Risk | Data LineageSenior-level Full TimeUS GA ATL 201, United States22h ago
-
Senior Software Engineer -Embedded Software (Onsite) USD 86K-165KAgile | Automated Build | Automated testing | C++ | Code Analysis401k match | Dental insurance | Employee assistance program | Employee scholar program | Flexible spending accountsSenior-level Full TimeUS-TX-PLANO-465 ~ 465 Independence Pkwy ~ …22h ago
-
Lunar AI Solutions Engineer USD 123K-173KAPIs | AWS | Agent Orchestration | Agile | Data Pipelines401k match | Education Support Program | Life insurance | Long-term disability | Medical/Dental/Vision insuranceEntry-level Full TimeCO - Littleton, United States22h ago
-
Senior-level Full TimeUnited States - Remote R22h ago
-
Hadoop Big Data Developer USD 100K-150KAirflow | Apache Flink | Apache Hive | Apache Hudi | Apache IcebergCareer growth opportunities | Health benefits | Mentorship | Remote workSenior-level Full TimeUnited States - Remote R22h ago
-
AI Data Engineer USD 100K-150KApache Beam | CI/CD | Data Lineage | Data Modeling | Data PrivacyCareer growth | Health benefits | Remote workMid-level Full TimeUnited States - Remote R22h ago