Big Data Lead
Tasks
- Automate ETL deployments with CI CD
- Create dimension tables
- Create fact tables
- Design data warehouses
- Develop ETL/ELT pipelines
- Implement data transformations
- Manage ETL version control
- Model star schema
- Monitor scheduled ETL jobs
- Optimize SQL queries
- Set up ETL error handling logging and recovery
- Tune database indexing and partitioning
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Glue | Amazon Redshift | Amazon S3 | Amazon Web Services | Automated Deployments | Azure | Azure Blob | Azure Blob Storage | Azure Data | Azure Data Factory | Azure DevOps | Blob Storage | Branching Strategies | CI/CD | Data Factory | Data Modeling | Data Recovery | Data Transformation | Data Warehousing | Data pipeline | Database Indexing | Database partitioning | Dimension tables | Dimensional Modeling | ELT | ETL | Error Handling | Fact tables | Git | Jenkins | Job Scheduling | Logging | Oracle | Performance Tuning | Query Optimization | SQL | Snowflake | Star Schema | Talend | TeamCity | Web Services
Education
N/A
Roles
Related jobs
-
Agile | Azure Data | Azure Data Factory | CI/CD | Data FactoryHybrid work scheduleSenior-level ContractBurbank, United States1d ago
-
Data Engineer USD 114K-190KApache Iceberg | Apache Kafka | Apache Spark | ClickHouse | Data GovernanceHealth insurance | Holiday pay | Learning and development | Life insurance | Long-term disabilitySenior-level Full TimeUSA-DC-Washington1d ago
-
API Design | C++ | CI/CD | CMake | Docker401k match | Dental insurance | Life insurance | Long-term disability | Medical insuranceSenior-level Full TimeNew York1d ago
-
AI Solution Engineer USD 109K-155KAPIs | AWS | Azure | Embeddings | GCP401k match | Basic life insurance | Dental insurance | Disability coverage | Medical insuranceMid-level Full TimePiscataway, NJ, US1d ago
-
Entry-level Full TimePalo Alto, CA, US, 943041d ago
-
AWS | Agile | CI/CD | Code review | Distributed Systems401k match | Commuter benefits | Disability insurance | Electric Car Charging Station | Employee assistance programSenior-level Full TimeSeattle, USA1d ago
-
AWS | Agile | CI/CD | Code review | Data Processing401k match | Commuter benefits | Electric Car Charging Station | Employee assistance program | Flexible spending accountsSenior-level Full TimeSeattle, USA1d ago
-
Robotics Software Engineer, Verification & Validation USD 191K-253KBare Metal | C++ | CANbus | CI/CD | Embedded LinuxEquity grants | Health benefits | Travel opportunityMid-level Full TimeCosta Mesa, California, United States1d ago
-
AWS | Anomaly Detection | Audience Segmentation | Clustering | DAXSenior-level Full TimeOPTIMIST HALL, United States1d ago
-
Principal Software Engineer USD 142K-304K.NET | Active Directory | Amazon S3 | Authentication and Authorization | AzureSenior-level Full TimeRedmond, WA, US1d ago
-
Senior Machine Learning Engineer USD 198K-287KData Engineering | Fine Tuning | Foundation Models | GenAI | Incident ResponseOn-call rotationSenior-level Full TimeRemote - US R1d ago
-
Agentic AI Engineer USD 176K-265KAccess Control | Anthropic | Arize | Audit Logging | CI/CDHybrid work arrangement | On-site collaborationSenior-level Full TimeSan Francisco, CA1d ago
-
Forward-Deployed Engineer, Data Centers USD 140K-165KAPI Integration | Agent workflows | Azure | CI/CD | Deployment401k match | Dental insurance | Device purchase support | Disability insurance | Flexible spending accountsMid-level Full TimeCalifornia1d ago
-
Data Analytics Lead USD 159K-190KDBT | Dashboards | Data Modeling | Data Pipelines | ETLHybrid work | In-office cultureSenior-level Full TimeNew York, NY1d ago
-
Sr. Solutions Engineer - Oil, Gas, Energy USD 152K-209KAWS | Account Management | Artificial Intelligence | Azure | Big DataSenior-level Full TimeHouston, Texas1d ago
-
Senior-level Full TimeRemote, US R1d ago
-
Senior Backend Engineer, ML Inference Systems USD 135K-237KCI/CD | Distributed Systems | Docker | GCP | GolangCommute subsidy | Employee resource groups | Employee stock ownership | Generous vacation and personal days | Global employee assistance programSenior-level Full TimeMountain View, CA, USA1d ago
-
Data Analyst with AI USD 100K-158KArtificial Intelligence | Business Intelligence | Cloud Platforms | Dashboarding | Data GovernanceContract role | Hybrid work scheduleMid-level Contract Full TimeHouston, TX, United States1d ago
-
Sr. Staff Machine Learning Engineer, Content Ecosystem USD 227K-469KCausal Inference | Data Quality | Experimentation | Game theory | Language ModelsSenior-level Full TimeSan Francisco, CA, US; Remote, US R1d ago
-
Sr. Data Architect III (6550) USD 174K-202KData Architecture | Data Engineering | Data Governance | Data Lineage | Data Management401k match | Dental insurance | Dependent care | Employee assistance | Flexible work arrangementsSenior-level Full TimeWashington, DC1d ago
-
Senior Data Platform Engineer USD 133K-197KAWS | Amazon IAM | Amazon Redshift | Ansible | Apache IcebergDental benefits | Free 1Password account | Generous paid time off | Health benefits | Maternity and Parental Leave Top-UpSenior-level Full TimeRemote (United States | Canada) R1d ago
-
AI Engineer I - Hybrid USD 125K-135KAI Services | API Development | Agentic Workflows | Azure | Azure AIHealth insurance | Hybrid work | Paid time off | Remote work options | Retirement planSenior-level Full TimeWindsor, Colorado, United States R1d ago
-
Agile | Django | Git | JavaScript | NoSQLEntry-level Full TimeAustin, Texas1d ago
-
Data Engineer USD 120K-160KApplication Insights | Azure Blob | Azure Blob Storage | Azure Data | Azure Data Factory401k match | Dental insurance | Employer sponsored lunches | Health insurance | Health savings account availabilitySenior-level Full TimeArkansas1d ago
-
Quantum Engineer USD 120K-155KAtomic physics | Coherent control | Cold atoms | Control Systems | Git401k matching | Dental insurance | Dependent care benefits | FSA | Health insuranceMid-level Full TimeBoulder, CO1d ago