Lead Data Engineer (Python, Spark, Glue, AWS)
Tasks
- Build data solutions with SQL NoSQL and distributed computing tools
- Collaborate with Agile teams to design develop test implement and support solutions
- Collaborate with product managers to deliver cloud-based experiences
- Develop data pipelines and cloud based data warehousing
- Mentor engineering community and share technology best practices
- Perform unit testing and code reviews
- Tune data processing for performance
- Utilize Python Spark and AWS Glue to process data
Perks/Benefits
Skills/Tech-stack
AWS Glue | Agile | Amazon Redshift | Amazon Web Services | Apache Hadoop | Apache Hive | Apache Kafka | Apache Spark | Java | MapReduce | MongoDB | NoSQL | Python | SQL | Scala | Shell Scripting | Snowflake | Unix/Linux | Web Services
Education
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Associate Data Engineer USD 46K-111KAutomated testing | Azure DevOps | BigQuery | CI/CD | Cloud StorageCompany-Paid Holidays | Employee assistance program | Life and disability insurance | Medical, dental, and vision coverage | Paid time offMid-level Full TimeNashville, TN, US5h ago
-
Senior-level Full TimeDenver, Colorado, United States R7h ago
-
Robotics Infrastructure Engineer USD 94K-220KAlerting | Build Automation | CI runners | CI/CD | Camera ModelsHigh autonomy | High output environmentMid-level Full TimeWatertown, MA7h ago
-
Staff Data Analyst USD 154K-239KData Modeling | Data Pipelines | Data Quality | Data Transformation | Data VisualizationDiversity, equity, inclusion and belonging | Social impact | Well-being programsSenior-level Full TimeSan Francisco, California8h ago
-
Senior Software Engineer, AI/ML USD 142K-203KAgent systems | Algorithms | Anthropic API | Backend APIs | CI/CDSenior-level Full TimeAustin, Texas, United States8h ago
-
Staff Machine Learning Engineer- AI Governance USD 169K-270KAI Governance | Agentic Frameworks | Bias | Data Drift | DockerSenior-level Full TimeFoster City, CA, United States9h ago
-
Senior-level Full TimeNew York, New York, United States9h ago
-
Senior-level Full TimeSan Francisco, California, United States9h ago
-
Senior Data Engineer Contractor- 8 months USD 120K-160KData Modeling | Data Partitioning | Data Quality | Data Validation | DatabricksSenior-level ContractWA - Bellevue9h ago
-
Senior Customer Success Engineer, North USD 144K-152KData Science | Databricks | Dataiku | Enterprise analytics | Generative AI401k company match | Commuter benefits | Dental insurance | Employer paid disability coverage | Flexible spending accountsSenior-level Full TimeUnited States, Remote R10h ago
-
Generative AI Consultant USD 94K-114KAWS | Anthropic | Azure | CI/CD | Chroma401k plan | Dental insurance | Flexible spending account | Flexible work environment | Gym reimbursementMid-level Full TimeNew York, NY, United States10h ago
-
Senior Machine Learning Engineer, Personalization USD 184K-262KAWS | Apache Beam | Apache Spark | Cloud platform | Data Processing401k | Health insurance | Meal allowance | Paid flexible holidays | Paid parental leaveSenior-level Full TimeNew York, NY11h ago
-
Data Engineer USD 135K-220KAWS | Bash | Docker | Hadoop | JavaInsurance | Paid leave | TelecommutingEntry-level Full TimeChicago, United States R12h ago
-
Data Engineer (remote) USD 85K-100KAgile | Apache Spark | Artificial Intelligence | Azure Data | Azure Data Factory401k match | Employee assistance program | Flexible schedule | Health insurance | Paid parental leaveMid-level Full TimeWork From Home, United States R14h ago
-
Lead Applied Scientist USD 150K-170KAgentic AI | Autogen | CrewAI | Data Quality | Deep learning401k match | Dental insurance | Employee assistance program | Employee recognition | Employee stock purchase planSenior-level Full TimeWork From Home, United States R14h ago
-
Data Science Lead USD 172K-268KA/B | A/B Testing | Airflow | B testing | Data Modeling401k match | Dental insurance | Health insurance | Life insurance | Long-term disabilitySenior-level Full TimeCary,North Carolina,United States15h ago
-
Senior DataOps Engineer USD 141K-182KAWS CloudFormation | Amazon EMR | Amazon Web Services | Ansible | Apache AirflowEmployee assistance program | Flexible Time Away From Work | Health & medical benefits | Learning budget | Life and disabilitySenior-level Full TimeRemote US R15h ago
-
Tech Lead, GTM Applied AI and Analytics USD 138K-225KAirflow | Amazon SageMaker | DBT | Databricks | Deep learningSenior-level Full TimeSan Francisco, CA, United States15h ago
-
AWS Data | AWS Data Warehouse | Amazon Web Services | Data Warehouse | SQLContract role | On site 3 days per weekMid-level Full TimeHouston, TX, United States16h ago
-
AI/ML Engineer USD 110K-165KAgile | Apache Spark | DevOps | Git | Machine Learning401k match | Dental insurance | Education & training benefits | Health insurance | Paid HolidaysMid-level Full TimeTampa, Hanscom, Colorado Springs, San Diego, … R16h ago
-
Mid-level Full TimeSalt Lake City, Utah16h ago
-
Data Engineer ID50062 USD 148K-164KAWS | AWS SageMaker | AWS SageMaker Studio | Airflow | Apache SparkEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionsSenior-level Full TimeBlacksburg, United States17h ago
-
.NET | .Net Core | AWS | Agentic AI | AzureSenior-level Contract Full TimeChicago, Illinois, United States17h ago
-
Machine Learning Engineer, Physical AI USD 168K-220KAWS | CUDA | Computer Vision | Deep learning | Fast.aiBi-annual off-sites | Dental insurance | Flexible PTO | Health insurance | In-person cultureMid-level Full TimeSan Francisco17h ago
-
Robotics Systems Engineer USD 70K-228K6DOF | Automation | Cameras | Cloud Computing | Computer VisionDental insurance | Flexible PTO | Health insurance | Learning budget | Offsites and socialsSenior-level Full TimeSan Francisco18h ago