Big Data Lead
Tasks
- Collaborate with stakeholders to gather requirements
- Design and develop data pipelines
- Implement data governance and quality checks
- Optimize data workflows and performance
- Perform data validation and troubleshooting
- Translate business requirements into technical designs
Perks/Benefits
- N/A
Skills/Tech-stack
Azure Data | Azure Data Factory | Azure Databricks | Data Factory | Data Transformation | Data profiling | Delta Lake | ETL | PySpark | SQL | Synapse Analytics | Version control
Education
Roles
Related jobs
-
Senior Lead Software Engineers USD 109K-192KApex | Change Sets | Copado | Gearset | JEECareer growth opportunities | Collaboration environment | Community involvement | Inclusive culture | Learning and development resourcesSenior-level Full TimeAlpharetta, GA, United States8h ago
-
Business Intelligence Analyst USD 76K-110KBigQuery | Business Strategy | Business strategy support | Data Analysis | Data GovernanceFlexible work arrangements | Professional development opportunitiesMid-level Full TimeHybrid (33182, Miami - United States … R8h ago
-
AI Cortex | AWS | Data Governance | Data Modeling | Data SecuritySenior-level ContractNew York, United States10h ago
-
Cloud Platforms | Data Migration | Data Pipelines | Data Quality | ETLSenior-level ContractMc Lean, United States10h ago
-
AI Tooling | Automation | C++ | CI/CD | Cloud ArchitectureSenior-level ContractBurbank, United States10h ago
-
Senior Engineer - Big Data and Business Intelligence USD 189K-199KAmazon EC2 | Amazon EMR | Amazon S3 | Big data management | Business ObjectsCareer growth opportunities | Mentorship opportunities | Training and certifications | Work in AI-driven environmentSenior-level Full TimeUSA-New York11h ago
-
AWS | Apache Airflow | BigQuery | ChromaDB | Cloud ComposerLong-term position | Paid time off | Work with great engineersSenior-level Full TimeLatin America, LATAM, United States11h ago
-
Senior GenAI Engineer USD 102K-210K.Net Core | AWS | Agent | Angular | AzureFlexible work arrangements | Health insurance | Inclusive culture | Professional developmentSenior-level Full TimeJersey City, New Jersey, United States12h ago
-
Developer/Programmer Analyst 3 (455-26-28423) USD 123K-161KAzure Data | Azure Data Factory | Data Factory | Data Governance | Data ModelingFlexible hours | TeleworkMid-level Full TimeAustin, TX, US21h ago
-
Data Engineer III USD 114K-180KAPI Integration | BI concepts | Data Warehousing | DevOps | GitHub Actions401k plan | Continuing education | Dental insurance | Disability insurance | Employee assistance programSenior-level Full TimeAustin, TX, United States1d ago
-
Principal Software Engineer, Machine Learning USD 107K-216KAWS | Airflow | Autosys | Azure | DockerEducational assistance | Employee match program | Health care | Paid time off | Parental leaveSenior-level Full Time100 New Millennium Way, Bldg 1, …1d ago
-
Senior-level Full TimeUS - Wilmington, NC - 929 … R1d ago
-
Analytics Migration Engineer USD 122K-177KAutomation | Cloud Platforms | Data Troubleshooting | Data Validation | ETL Processes401k plan | Dental coverage | Flexible time off | Medical coverage | Paid HolidaysMid-level Full TimeDearborn, United States1d ago
-
Sr. Data Engineer USD 72K-141KAgile | Airflow | Cloud Composer | Cloud platform | Control-MFlexible work arrangements | Professional development opportunitiesSenior-level Full TimeUS- IL40- Chicago-151N Frankln, United States1d ago
-
BI Data Engineer USD 148K-246KAPIs | AWS | Azure | Capacity Planning | Data GovernanceHealth insurance | Paid time off | Professional development | Remote workSenior-level Full TimeCalifornia - San Francisco, United States1d ago
-
Senior Full-Stack Engineer (Enterprise Data & Apps) USD 130K-160KAPI Development | APIs | Azure | CI/CD | Data EngineeringCareer development opportunities | Flexible work arrangements | Health insuranceSenior-level Full TimeUSA-CA - Los Angeles HQ, United …1d ago
-
Mid-level Full TimeUS Home Office, United States1d ago
-
Databricks Data Engineer USD 105K-170KCI/CD | Container Orchestration | Data Modeling | Databricks | Delta LakeCertifications support | Dental insurance | Flexible benefits | Learning opportunities | Medical insuranceMid-level Full TimeGH Office: Arlington, VA, United States1d ago
-
Databricks Data Engineer USD 105K-170KApache Kafka | CD pipelines | CI/CD | CI/CD pipelines | Container Orchestration401k plan | Dental insurance | Disability benefits | Employee referral program | Flexible work arrangementsMid-level Full TimeGH Office: Arlington, VA, United States1d ago
-
Senior Data Engineer USD 141K-168KApache Airflow | Azure | Data Governance | Data Modeling | Data PipelinesEmployee discount | Fitness reimbursement | Medical, dental coverage | Paid Holidays | Paid time offSenior-level Full TimeNo. Andover, MA Chestnut St., United …1d ago
-
Senior-level Full TimeOpen to Remote (USA); Pittsburgh, PA R1d ago
-
Data Engineer USD 160K-192KAzure Data | Azure Data Factory | Azure Data Lake | Azure Synapse | CDCDental insurance | Flexible work culture | Medical insurance | Retirement plan | Tuition reimbursementSenior-level Full TimeUS - Houston1d ago
-
Data Engineer, Principal USD 127K-198KAutomation | Cloud Platforms | Data Architectures | Data Governance | Data ModelingSenior-level Full TimeUnited States1d ago
-
Machine Learning Engineer - Insurance AI USD 75K-90KAPI Integration | AWS | CI/CD | Data Engineering | DockerFlexible leave policies | Health insurance discount | LinkedIn Learning access | Parental leave | Subscription to NearmapEntry-level Full TimeCarlsbad, CA, United States1d ago
-
Lead Analytics Engineer USD 130K-154KData Analysis | Data Architecture | Data Lake | Data Modeling | Data PipelinesSenior-level Full TimeUnited States1d ago