Big Data Lead
Tasks
- Apply data engineering best practices
- Apply security best practices IAM encryption secrets management
- Build data pipelines
- Consume RESTful APIs
- Define technical designs from requirements
- Design data warehouse solutions
- Develop data integration architectures
- Implement CI/CD pipelines
- Implement batch and event driven integrations
- Integrate enterprise and external data
- Manage configurations
- Provide operational support
- Set up testing and code reviews
- Use infrastructure as code
- Work in Agile delivery
Perks/Benefits
- N/A
Skills/Tech-stack
Agile | CI/CD | Cloud Data | Cloud Data Engineering | Code review | Configuration Management | Data Engineering | Data Pipelines | Data Warehouse | Data integration | Encryption | Event Driven | Event Streaming | Event-driven architecture | IAM | Infrastructure as Code | Messaging | Near-real-time | Operational support | REST API | Real Time | Relational databases | Secrets management | Snowflake | Testing | “as-code”
Education
N/A
Roles
Big Data Lead | Data Engineer | Data Lead | Engineer | Lead | Senior Data Engineer
Related jobs
-
Sr. Data Engineer USD 98K-130KAgile | Airflow | CI/CD | DBT | Data ArchitectureBusiness casual environment | Dental insurance | Life insurance | Medical insurance | Paid HolidaysSenior-level Full TimeLatham, NY, United States1h ago
-
Computer Vision Engineer USD 147K-208KComputer Vision | Edge Computing | Gesture Recognition | Hand tracking | Machine LearningSenior-level Full TimeBurlingame, CA6h ago
-
Senior-level Full TimeSunnyvale, CA6h ago
-
Software Engineer, BigQuery Metadata USD 147K-211KBigQuery | C++ | Compute Technologies | Data Warehouse | Data analyticsMid-level Full TimeKirkland, WA, USA6h ago
-
Research Engineer, DeepMind USD 262K-365KBigQuery | Data Pipelines | Data analytics | Distributed Systems | FlumeSenior-level Full TimeMountain View, CA, USA6h ago
-
Access Management | Algorithms | CI/CD | Cloud platform | ComplianceEquity | Health insurance | Paid time off | Performance bonus | Retirement benefitsSenior-level Full TimeReston, VA, USA6h ago
-
Senior Software Engineer, Infrastructure, Cloud AI USD 174K-253KAlgorithms | Artificial Intelligence | Cloud Computing | Code review | Continuous LearningContinuous learning | Growth opportunities | Mentorship opportunities | Psychological safety | Supportive teamSenior-level Full TimeNew York, NY, USA6h ago
-
Principal Data Scientist, IT Analytics USD 51K-86KAgile | Computer Vision | Data Science | Deep learning | Forecasting401k program | Discounts on hotels cars and cruises | Employee assistance program | Flexible spending accounts | Health dental vision prescription benefitsSenior-level Full TimeFort Worth, TX, US10h ago
-
VP, Data Engineer - DataBricks USD 143K-190KAzure | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageHybrid work model | Work from home optionExecutive-level Full TimeCharlotte, NC, US, 2820210h ago
-
Senior Software Engineer, Data Insights USD 196K-243KAWS VPC | Amazon EKS | Analytics infrastructure | Apache Superset | Data EngineeringSenior-level Full TimeSan Mateo, CA, United States R11h ago
-
Senior Software Engineer, Unsecured Installments USD 160K-223KA/B | A/B Testing | Accessibility | B testing | CI/CD401k match | Dental insurance | Disability insurance | Health insurance | Health savings accountSenior-level Full TimeUnited States | Remote R13h ago
-
Software Engineer, Unsecured Installments USD 136K-196KCI/CD | Cypress | GraphQL | Java | JavaScript401k | Company holidays | Dental insurance | Employee assistance program | Health insuranceSenior-level Full TimeUnited States | Remote R13h ago
-
Technical Program Lead, AI Delivery USD 162K-226KData Modeling | Data Pipelines | Data Science | Generative AI | KPI TrackingClient-facing work | Executive visibility | Hybrid work | Mentorship and team leadershipSenior-level Full TimeSan Francisco14h ago
-
Machine Learning Engineer USD 120K-150KBERT | CI/CD | Document parsing | Embeddings | Fine Tuning401k matching | Dental insurance | Employee assistance program | Flexible spending account | Health savings accountMid-level Full TimeRemote (United States) R15h ago
-
Entry-level Full TimeMadison, WI, US16h ago
-
AI Enabled Engineer | Columbus USD 44K-154KAWS | Agile | Azure | CI/CD | Conversational AI401k retirement plan | Medical, dental, and vision benefits | Paid Holidays | Paid time off | Variable pay/incentivesMid-level Full TimeUnited States16h ago
-
Campus Data Engineer (Intern) USD 250K-250KAgile | Data Pipelining | Data Structures | Database Management | LinuxCPT OPT eligibility | Mentorship | Work visa sponsorshipEntry-level InternshipChicago17h ago
-
Algorithms Software Engineer USD 161K-175KComputer Vision | Deployment | Image Processing | Machine Learning | NumPyTelecommuting permittedEntry-level Full TimeSan Francisco HQ Office17h ago
-
Agent Frameworks | Agent systems | Azure AI | CI/CD | Copilot StudioExecutive-level Full TimePurchase, New York, United States17h ago
-
Senior Engineer - Machine Learning - Regulatory USD 154K-199KARIMA | Agent Orchestration | Anomaly Detection | Automated testing | BigQuery401k match | Dental insurance | Employee stock purchase plan | Health insurance | Mental health servicesSenior-level Full TimeChicago HQ OPO, United States17h ago
-
Machine Learning Engineer, Connectomics USD 82K-130KAffinity prediction | BigDataViewer | C++ | CAVE | Cloud infrastructureMid-level Full TimeSan Francisco18h ago
-
Senior Applied AI Engineer USD 200K-250KAgentic Systems | Cost Optimization | Data Pipelines | Deep learning | Fine TuningDental insurance | Flexible PTO | Health insurance | In person options | Remote workSenior-level Full TimeSan Francisco Office18h ago
-
Senior-level Full TimeBerkeley, CA19h ago
-
Biological Structures Data Engineer I/II USD 129K-190KAWS | CIF | Cloud Computing | Code review | Data Curation401k matching | Dining | Flexible spending accounts | Health insurance | Hybrid workMid-level Full TimeBoston Office19h ago
-
AI Developer USD 160K-195KAPI Gateway | AWS Bedrock | AWS Lambda | AWS Step Functions | Amazon DynamoDBMid-level Full TimePlano, TX, United States19h ago