Big Data Lead
Tasks
- Automate ETL deployments with CI CD
- Create dimension tables
- Create fact tables
- Design data warehouses
- Develop ETL/ELT pipelines
- Implement data transformations
- Manage ETL version control
- Model star schema
- Monitor scheduled ETL jobs
- Optimize SQL queries
- Set up ETL error handling logging and recovery
- Tune database indexing and partitioning
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Glue | Amazon Redshift | Amazon S3 | Amazon Web Services | Automated Deployments | Azure | Azure Blob | Azure Blob Storage | Azure Data | Azure Data Factory | Azure DevOps | Blob Storage | Branching Strategies | CI/CD | Data Factory | Data Modeling | Data Recovery | Data Transformation | Data Warehousing | Data pipeline | Database Indexing | Database partitioning | Dimension tables | Dimensional Modeling | ELT | ETL | Error Handling | Fact tables | Git | Jenkins | Job Scheduling | Logging | Oracle | Performance Tuning | Query Optimization | SQL | Snowflake | Star Schema | Talend | TeamCity | Web Services
Education
N/A
Roles
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R1d ago
-
Sr. Data Engineer USD 98K-130KAgile | Airflow | CI/CD | DBT | Data ArchitectureBusiness casual environment | Dental insurance | Life insurance | Medical insurance | Paid HolidaysSenior-level Full TimeLatham, NY, United States1h ago
-
Risk Adjustment Analytics Data Scientist USD 122K-240KActuarial analysis | Cohort Segmentation | Data Quality | Data profiling | DatabricksMentorship | Professional developmentSenior-level Full TimeArlington/Rosslyn, Virginia, United States5h ago
-
Software Engineer, BigQuery Metadata USD 147K-211KBigQuery | C++ | Compute Technologies | Data Warehouse | Data analyticsMid-level Full TimeKirkland, WA, USA6h ago
-
Bash | Cause analysis | Continuous Process | Continuous Process Improvement | Corrective actionsSenior-level Full TimeSunnyvale, CA, USA6h ago
-
Access Management | Algorithms | CI/CD | Cloud platform | ComplianceEquity | Health insurance | Paid time off | Performance bonus | Retirement benefitsSenior-level Full TimeReston, VA, USA6h ago
-
Artificial Intelligence Engineer I USD 99K-176KAWS | Azure | Bioinformatics | Deep learning | DockerMid-level Full TimeHouston, TX, US8h ago
-
VP, Data Engineer - DataBricks USD 143K-190KAzure | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageHybrid work model | Work from home optionExecutive-level Full TimeCharlotte, NC, US, 2820210h ago
-
Senior Software Engineer, Data Insights USD 196K-243KAWS VPC | Amazon EKS | Analytics infrastructure | Apache Superset | Data EngineeringSenior-level Full TimeSan Mateo, CA, United States R11h ago
-
Senior Software Engineer, Unsecured Installments USD 160K-223KA/B | A/B Testing | Accessibility | B testing | CI/CD401k match | Dental insurance | Disability insurance | Health insurance | Health savings accountSenior-level Full TimeUnited States | Remote R13h ago
-
Software Engineer, Unsecured Installments USD 136K-196KCI/CD | Cypress | GraphQL | Java | JavaScript401k | Company holidays | Dental insurance | Employee assistance program | Health insuranceSenior-level Full TimeUnited States | Remote R13h ago
-
Senior Machine Learning Engineer, Voice Assistant USD 195K-361KAmazon EMR | Amazon S3 | Apache Airflow | Apache Spark | Artificial IntelligenceFinancial wellness support | Flexible remote work | Mental health support | Paid time offSenior-level Full TimeAustin, Texas13h ago
-
Senior Machine Learning Engineer, Voice Assistant USD 216K-273KAmazon EMR | Amazon S3 | Apache Airflow | Automated Speech Recognition | C++Disability benefits | Equity awards | Health insurance | Hybrid work flexibility | Life insuranceSenior-level Full TimeBoston, Massachusetts13h ago
-
Senior Machine Learning Engineer, Voice Assistant USD 229K-367KAmazon EMR | Amazon S3 | Apache Airflow | Apache Spark | Artificial IntelligenceDisability benefits | Equity awards | Health insurance | Life insurance | Paid time offSenior-level Full TimeSan Jose, California13h ago
-
Staff Software Engineer, Full Stack - Gen AI USD 252K-315KAWS | Azure | Cloud platform | Google Cloud | Google Cloud PlatformCommuter stipend | Generous paid time off | Health, dental, vision coverage | Learning and development stipend | Retirement benefitsSenior-level Full TimeNew York, NY; San Francisco, CA; …14h ago
-
Machine Learning Engineer USD 120K-150KBERT | CI/CD | Document parsing | Embeddings | Fine Tuning401k matching | Dental insurance | Employee assistance program | Flexible spending account | Health savings accountMid-level Full TimeRemote (United States) R15h ago
-
Entry-level Full TimeMadison, WI, US15h ago
-
AI Enabled Engineer | Columbus USD 44K-154KAWS | Agile | Azure | CI/CD | Conversational AI401k retirement plan | Medical, dental, and vision benefits | Paid Holidays | Paid time off | Variable pay/incentivesMid-level Full TimeUnited States15h ago
-
Senior Data Engineer USD 157K-218KAWS | AWS Glue | Amazon Athena | Amazon EKS | Amazon EMRAdoption reimbursement | Commuter stipend | Fertility reimbursement | Flexible PTO | In office meals stipendSenior-level Full TimeDenver, Colorado, United States; San Francisco, …17h ago
-
Agent Frameworks | Agent systems | Azure AI | CI/CD | Copilot StudioExecutive-level Full TimePurchase, New York, United States17h ago
-
Senior Engineer - Machine Learning - Regulatory USD 154K-199KARIMA | Agent Orchestration | Anomaly Detection | Automated testing | BigQuery401k match | Dental insurance | Employee stock purchase plan | Health insurance | Mental health servicesSenior-level Full TimeChicago HQ OPO, United States17h ago
-
Data Engineer (Starlink) USD 125K-175KAI Agents | APIs | CRM | CRM Data Deduplication | CRM data401k retirement plan | Dental insurance | Employee stock purchase plan | Life insurance | Long-term disability insuranceSenior-level Full TimeHawthorne, CA18h ago
-
Senior-level Full TimeBastrop, TX18h ago
-
Senior-level Full TimeBerkeley, CA19h ago
-
Biological Structures Data Engineer I/II USD 129K-190KAWS | CIF | Cloud Computing | Code review | Data Curation401k matching | Dining | Flexible spending accounts | Health insurance | Hybrid workMid-level Full TimeBoston Office19h ago