Lead Data Engineer
Tasks
- Build cloud based data warehousing
- Collaborate with agile teams
- Collaborate with product managers
- Conduct code reviews
- Design data solutions
- Develop data pipelines
- Develop real-time data streaming applications
- Experiment with new technologies
- Mentor engineering community
- Optimize performance
- Perform unit testing
- Support production data systems
- Test and implement technical solutions
Perks/Benefits
Skills/Tech-stack
Agile | Amazon Web Services | Cassandra | Cloud Computing | Cloud platform | Data Streaming | Data Warehousing | Distributed Computing | EMR | Google Cloud | Google Cloud Platform | Hadoop | Hive | Java | Kafka | Linux | MapReduce | Microservices | Microsoft Azure | MongoDB | NoSQL | Python | RDBMS | Real Time | Real-time Data | Redshift | SQL | Scala | Shell Scripting | Snowflake | Spark | Unit Testing | Unix | Web Services
Education
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R29d ago
-
Data Engineer III/Senior (Analytics) USD 130K-170KAnalytics engineering | Azure | CCPA | CI/CD | DORA Metrics401k retirement plan | Dental insurance | Employee stock purchase plan | Health insurance | Life insuranceSenior-level Full TimeIrving, TX, United States R9h ago
-
AI Search | AI Security | AWS | AWS Bedrock | Agent memoryHybrid work | In-person interviewSenior-level Contract Full TimeJersey City, NJ, United States R10h ago
-
Senior Data Engineer USD 109K-163KAI | API | Analytics Platforms | Analytics solutions | Apache Spark401k | Adoption Assistance | Defined contribution | Discount programs | Employee assistance programsSenior-level Full TimeJohnston, IA,Iowa,United States11h ago
-
Sr. Databricks Consultant - Top Secret Clearance USD 175K-250KAWS S3 | Apache Spark | Azure Data | Azure Data Lake | CI/CDTop Secret clearanceSenior-level Full TimeFAIRFAX, VA, United States11h ago
-
Sr. Databricks Consultant - TS/SCI-FSP USD 175K-250KAWS | AWS S3 | Apache Spark | Azure | Azure DataAdditional funding contingent | Benefits package | Travel as neededSenior-level Full TimeFAIRFAX, VA, United States11h ago
-
Mid-level Full TimeKing George, VA, United States11h ago
-
Sr. Databricks Consultant - DHS Public Trust USD 175K-250KAWS S3 | Apache Spark | Azure Data | Azure Data Lake | CI/CDSenior-level Full TimeWork from home, VA, United States11h ago
-
Hiring for Senior AI Software Engineer (Agentic AI / AI Agents) | Hybrid | W2 Role | F2F Interview in NJ USD 115K-150KAI Agents | AWS | Agentic AI | Audit Logging | AzureHybrid work | In-person interviewSenior-level Contract Full TimeJersey City, NJ, United States12h ago
-
Data Architect (Hybrid - St. Paul, MN) USD 130K-174KAccess Control | Azure | Azure Backup | Azure CLI | Azure DataHybrid work | W2 employmentSenior-level Full TimeSt Paul, Minnesota R12h ago
-
Ab Initio | Agile | Data Integrity | Data Management | Data ModelingHybrid work | Local candidates onlyMid-level Full TimeDallas, Texas12h ago
-
Principal Data Engineer – (Hadoop/Big Data, AWS, Python, Kinesis) - Irvine, CA - Onsite - Contract to Hire - AS A USD 132K-165KAmazon Kinesis | Amazon RDS | Amazon Redshift | Amazon Web Services | Apache HBaseSenior-level Full TimeIrvine, CA12h ago
-
Principal AI Engineer – Agentic AI / Generative AI | Irvine, CA (Hybrid) | Contract to Hire | AS A USD 100K-150KAI Agents | API | AWS | Agent systems | CI/CDContract-to-hire | Hybrid workSenior-level Full TimeIrvine, CA R12h ago
-
ABAC | AWS | Access Management | Apache Iceberg | CI/CDSenior-level Full TimeBoston, MA, United States14h ago
-
Senior Data Engineer ID75059 USD 155K-170KAPI Integration | AWS | Apache Airflow | Apache Spark | AvroEducation budget | Exciting projects | Fitness budget | Flexible schedule | MentorshipSenior-level Full TimeBaltimore, United States R14h ago
-
Senior Data Engineer ID75059 USD 155K-170KAPI Integration | AWS | Apache Airflow | Apache Spark | AvroEducation budget | Exciting projects | Fitness budget | Flexible schedule | MentorshipSenior-level Full TimeHouston, United States R14h ago
-
Senior Data Engineer ID75059 USD 155K-170KAPI Integration | AWS | Airflow | Apache Kafka | AvroFlexible schedule | Mentorship | Personalized growth roadmaps | Professional growth | Remote and office optionsSenior-level Full TimeWest Palm Beach, United States R14h ago
-
Senior Data Engineer ID75059 USD 155K-170KAWS | Apache Airflow | Apache Spark | Avro | DuckDBEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapsSenior-level Full TimeBoca Raton, United States R14h ago
-
Senior Data Engineer ID75059 USD 155K-170KAWS | Airflow | Apache Kafka | Apache Spark | AvroFlexible schedule | Mentorship | Office options | Personalized growth roadmaps | Remote work optionsSenior-level Full TimeJersey City, United States R14h ago
-
Senior Data Engineer ID75059 USD 155K-170KAPI Integration | AWS | AWS Glue | Apache Airflow | Apache SparkEducation budget | Fitness budget | Flextime | Mentorship | Personalized growth roadmapsSenior-level Full TimeTallahassee, United States R14h ago
-
Senior Data Engineer ID75059 USD 155K-170KAPI Integration | AWS | Airflow | Apache Spark | AvroFlexible schedule | Mentorship | Office options | Personalized growth roadmaps | Remote work optionsSenior-level Full TimeJacksonville, United States R14h ago
-
Senior Data Engineer ID75059 USD 155K-170KAWS | Airflow | Amazon SageMaker | Amazon SageMaker Studio | Apache SparkEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapsSenior-level Full TimeLos Angeles, United States R14h ago
-
Senior Data Engineer ID75059 USD 155K-170KAPIs | AWS | Airflow | Avro | DuckDBEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapSenior-level Full TimeFort Lauderdale, United States R14h ago
-
Senior Data Engineer ID75059 USD 155K-170KAWS | Airflow | Apache Spark | Avro | DuckDBEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionSenior-level Full TimeChicago, United States R14h ago
-
Senior Data Engineer ID75059 USD 155K-170KAPI Integration | AWS | Apache Airflow | Apache Spark | AvroFlexible schedule | Mentorship | Office options | Personalized growth roadmaps | Remote work optionsSenior-level Full TimeBoston, United States R14h ago