Lead Data Engineer - Data Publication and Transformation
Tasks
- Build full stack data processing systems
- Build real time data and streaming pipelines
- Collaborate with agile teams
- Design develop test implement and support data solutions
- Develop data transformation workflows
- Implement cloud-based data warehousing
- Mentor engineering community
- Perform unit testing and code reviews
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Agile | Amazon Redshift | Apache Flink | Apache Kafka | Apache Spark | Distributed Computing | DynamoDB | EMR | Go | Golang | Google Cloud | Java | MapReduce | Microservices | Microsoft Azure | NoSQL | PostgreSQL | Python | R | SQL | Scala | Shell Scripting | Snowflake | Unit Testing | Unix/Linux
Education
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Analytics Engineer (Remote) USD 104K-170KAWS | Apache Airflow | CI/CD | Containerization | Docker401k match | Flexible time off | Medical/Dental/Vision insurance | Paid Holidays | Remote work flexibilityMid-level Full TimeUnited States, UNITED STATES, United States R8h ago
-
Data Engineer USD 74K-133KAgile | Apache Airflow | Cloud Composer | Cloud Data | Cloud Dataflow401k retirement program | Annual incentive program | Dental insurance | Disability insurance | Flexible time offMid-level Full TimeLisle, IL, United States R9h ago
-
Staff Machine Learning Engineer USD 119K-196KAsync Python | BigQuery | CI/CD | Causal Inference | Cloud RunSenior-level Full TimeNew York,US-NY,United States R10h ago
-
AI Engineer - Nexus Black USD 90K-100KAPI Integration | CI/CD | Cloud services | Data Modeling | Embeddings401k match | Community Involvement and Volunteering | Disability benefits | Flexible paid time off | Flexible spending accountsSenior-level Full TimeItasca, Illinois, United States11h ago
-
Sr. Data Engineer USD 98K-130KAgile | Airflow | CI/CD | DBT | Data ModelingDental insurance | Life insurance | Medical insurance | Paid Holidays | Paid time offSenior-level Full TimeLatham, NY, United States11h ago
-
Data Modeling | Data Pipeline Monitoring | Data Quality | Data Warehousing | Data pipelineMarket-relevant benefits | Professional growth opportunitiesMid-level Full TimeChicago, IL, United States12h ago
-
AI | Automation | Data Governance | Data Management | Data OperationsSenior-level Full TimePrinceton15h ago
-
Data Engineer USD 128K-214KAWS Glue | AWS GovCloud | Apache Airflow | Apache Iceberg | Apache KafkaSenior-level Full TimeUSA-FL-Doral15h ago
-
Software Engineer III - Java/Python - Learn AI / LLM USD 176K-195KAgile | Amazon Web Services | Application Resiliency | Artificial Intelligence | Automated testingSenior-level Full TimeNew York, NY, United States16h ago
-
Software Engineer, SystemML - AI Networking USD 170K-251KC# | C++ | CUDA | Data-parallel | Distributed Data ParallelMid-level Full TimeMenlo Park, CA16h ago
-
Research Software Engineer, Multimodal AI USD 174K-253KC plus plus | Computer Vision | Deep learning | Distributed Computing | Few-Shot LearningMid-level Full TimeSan Jose, CA, USA16h ago
-
Forward Deployed Engineer V, Generative AI, Google Cloud USD 262K-365KAPI Integration | Agent systems | Cloud platform | CrewAI | Data PipelinesSenior-level Full TimeSan Francisco, CA, USA; Atlanta, GA, …16h ago
-
Automation | C# | C++ | CSS | Database DesignMid-level Full TimeAnn Arbor, MI, USA16h ago
-
Principal Consultant, AI/ML, Mandiant, Google Cloud USD 168K-244KAI Evaluation | Agent systems | Cloud APIs | Cybersecurity | Data leakageSenior-level Full TimeReston, VA, USA; United States16h ago
-
Senior Product Engineer, Machine Learning Accelerators USD 144K-209KBash | Board assembly | Cause analysis | Circuit board assembly | Continuous ProcessSenior-level Full TimeSunnyvale, CA, USA16h ago
-
Software Engineer III, Cloud Bigtable SQL and Analytics USD 147K-211KApache Beam | Apache Spark | C++ | Cassandra | ConcurrencyEquity | Health insurance | On-call rotation | Paid time offSenior-level Full TimeNew York, NY, USA16h ago
-
Senior-level Full TimeAuburn Hills, MI, United States16h ago
-
Lead Data Engineer USD 110K-170KAWS Athena | AWS Glue | AWS Lambda | AWS S3 | Amazon AuroraDistance based relocation assistance | Employee assistance program | Employee business networks | Enhanced 401k | Flexible work hoursSenior-level Full TimeHolyoke, MA, 01040, USA19h ago
-
Data Engineer USD 77K-125KAPI Integration | Azure | DBT | Data Governance | Data Modeling401k match | Dental insurance | Employee assistance program | Employee stock purchase plan | Flexible spending accountsMid-level Full TimeLouisville, KY, 40223-4145, USA19h ago
-
Embedded Software Test Engineer USD 105K-158K5S | Agile | C# | CI/CD | Case Development401k | Disability insurance | Employee stock purchase plan | Fully remote | Health insuranceMid-level Full TimeHarrisburg, PA, US, 17111 R21h ago
-
Senior-level Full TimeSan Jose, California, United States23h ago
-
Machine Learning Infrastructure Engineer USD 140K-165KAWS | Alerting | Batching | Caching | Cost OptimizationSenior-level Full TimeSan Jose, California, United States23h ago
-
Senior Machine Learning Engineer, Ad Serving USD 195K-408KData Science | Experimentation | Feature Engineering | Java | Machine LearningDisability benefits | Health insurance | Life insurance | Paid time off | Parental leaveSenior-level Full TimeNew York, New York23h ago
-
Senior Machine Learning Engineer, Ad Serving USD 195K-352KContinuous Improvement | Distributed Systems | Experimentation | Feature Engineering | JavaDisability benefits | Equity awards | Health insurance | Life insurance | Paid time offSenior-level Full TimeBoston, Massachusetts23h ago
-
Principal Software Engineer, Perception Pretraining USD 349K-431KC++ | Compute Optimization | Computer Vision | End to End | End-to-end modelingCompany benefits | Discretionary annual bonus | Equity incentive planSenior-level Full TimeMountain View, CA, USA; San Francisco, …1d ago