Distinguished Data Engineer
Tasks
- Build and optimize Flink or Spark data processing
- Build and optimize Kafka based data pipelines
- Build data pipeline technology roadmaps
- Detect data issues and remediate
- Develop data engineering platform scalability
- Engineer data integrations using AWS
- Enhance performance and resiliency of big data systems
- Implement data observability for lineage and data quality
- Improve data pipeline operational excellence
- Maintain data lakehouse systems with Snowflake and Databricks
- Mentor engineers and lead technical recruiting
- Orchestrate workflows with Airflow
- Write Java code for data processing
- Write Python code for data processing
- Write SQL code for data processing
- Write Scala code for data processing
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Apache Airflow | Apache Flink | Apache Iceberg | Apache Spark | Databricks | Delta Lake | Java | Kafka | Lakehouse | Python | SQL | Scala | Snowflake
Education
Roles
Related jobs
-
Data Engineer ID50062 USD 148K-170KAmazon Web Services | Apache Airflow | Apache Spark | Avro | Cloud platformEducation budget | Fitness budget | Flexible schedule | Mentorship | Remote work optionSenior-level Full TimeSan Francisco, United States4h ago
-
DevOps Engineer - Project Delivery Senior Analyst USD 107K-173KAnsible | Argo CD | Bash | CI/CD | DockerSenior-level Full TimeDallas, Texas, United States5h ago
-
Senior Software Engineer, Cross Platform Applications USD 212K-387KArtificial Intelligence | Automation | Code Analysis | Dynamic analysis | JavaScriptSenior-level Full TimeSan Jose, California, United States5h ago
-
Machine Learning Engineer, AI Coding Tools USD 156K-387KDeep learning | GPU clusters | Inference acceleration | Language Models | Large Language ModelsMid-level Full TimeSan Jose, California, United States5h ago
-
Data Engineer USD 62K-62KAzure Data | Azure Data Factory | DBT | Data Factory | Data Modeling401k | Dental insurance | Disability insurance | Flexible spending account | Internal promotion opportunitiesMid-level Full TimeKS, Leawood5h ago
-
Lead Solution Architect (AI & Data Applications)_U.S USD 175K-225KAngular | Autogen | CI/CD | Databricks | Databricks AppsSenior-level Full TimeJersey City, NJ, United States5h ago
-
Backend Software Engineer - Security Data USD 122K-316KApache Kafka | Apache Spark | Data Modeling | Data Quality | ETLMid-level Full TimeSan Jose, California, United States5h ago
-
C++ | Cloud platform | Conversational AI | Document AI | Evaluation FrameworksConferences and industry events participation | Industry thought leadership | Technical product briefingsSenior-level Full TimeReston, VA, USA; Boulder, CO, USA6h ago
-
Senior Software Engineer, AI/ML GenAI USD 174K-252KC++ | Capacity Management | Cloud platform | Computer Vision | Data ProcessingSenior-level Full TimeSunnyvale, CA, USA6h ago
-
Software Engineer, AI/ML Infrastructure, TILES USD 147K-211KArtificial Intelligence | Automation | C++ | Capacity Management | Data StorageMid-level Full TimeSunnyvale, CA, USA6h ago
-
Staff Software Engineer, Data Center Resource Modeling USD 207K-300KAPI Design | C++ | Data Center Management | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeKirkland, WA, USA6h ago
-
C++ | Data Processing | Debugging | Generative AI | Language ModelsSenior-level Full TimeMountain View, CA, USA6h ago
-
C++ | Data Processing | Data Structures | Data Structures and Algorithms | DebuggingSenior-level Full TimeMountain View, CA, USA6h ago
-
Senior Software Engineer, AI/ML, Search Ads USD 174K-252KAds bidding | C++ | Data Science | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeNew York, NY, USA; Mountain View, …6h ago
-
Staff Datacloud Blackbelt Engineer, Data and AI USD 183K-265KAI Engineering | AI/ML | AI/ML workflows | BigQuery | Cloud ArchitectureSenior-level Full TimeSunnyvale, CA, USA6h ago
-
Staff Software Engineer, Generative AI, Core ML USD 207K-300KAI Feedback | Computer Vision | Data Processing | Deep learning | Digital TwinSenior-level Full TimeMountain View, CA, USA6h ago
-
Customer Engineer III, Applied AI, Google Cloud USD 174K-252KAgent tooling | C++ | Cloud Native | Cloud Native Architecture | Conversational AISenior-level Full TimeNew York, NY, USA; Chicago, IL, …6h ago
-
APIs | Agent systems | CrewAI | Fine Tuning | Hugging FaceSenior-level Full TimeAddison, TX, USA; Austin, TX, USA6h ago
-
Software Engineer III, AI/ML GenAI, YouTube USD 147K-211KC++ | Computer Vision | Data Processing | Debugging | Distributed ComputingSenior-level Full TimeMountain View, CA, USA6h ago
-
Software Engineer III, AI/ML, Google Ads USD 147K-211KAlgorithms | C++ | Data Processing | Data Structures | DebuggingSenior-level Full TimeMountain View, CA, USA; Los Angeles, …6h ago
-
C++ | Data Architecture | Data Mining | Data Modeling | Data ProcessingEntry-level Full TimeSunnyvale, CA, USA6h ago
-
Cloud Computing | Cloud TPU | Cloud platform | Data Processing | DebuggingSenior-level Full TimeKirkland, WA, USA; Seattle, WA, USA6h ago
-
Machine Learning Engineer USD 111K-180KAutomation | Business Intelligence | Cloud Computing | Dashboard Development | Data PipelinesMid-level Full TimeAlexandria, VA, United States9h ago
-
Forward Deployed Solution Architect USD 100KAmazon Redshift | Artificial Intelligence | Audience Segmentation | Automation platforms | CRM IntegrationsSenior-level Full TimeSeattle15h ago
-
Software Engineer III - AI/ML, Java / Python USD 177K-215KAPI Development | AWS | Agentic AI | Agile methodologies | Application ResiliencyBackup childcare | Financial coaching | Health care coverage | Mental health support | On-site wellness centersSenior-level Full TimePlano, TX, United States15h ago