Data Engineer
Tasks
- Collaborate with data architects analytics teams and stakeholders
- Design data pipelines
- Develop and manage ELT ETL processes
- Develop code document and execute tests
- Develop data solutions
- Develop detailed plans and estimates
- Document architecture data flows and procedures
- Ensure data quality, security, and compliance
- Lead data migration projects
- Optimize Snowflake data warehouse
- Participate in requirements gathering
- Prepare technical specifications
- Run optimize SQL queries
- Troubleshoot performance and data issues
Perks/Benefits
Skills/Tech-stack
AWS Azure GCP | Azure GCP | Bash Scripting | Cloud Platforms | Cloud Platforms (AWS | Cloud platforms AWS Azure | Cloud platforms AWS Azure GCP | DBT | Data Governance | Data Migration | Data Modeling | Data Pipeline Development | Data Quality | Data Security | Data Warehousing | Data integration | Data pipeline | ETL/ELT | Fivetran | Hadoop | Informatica | Java | Liquibase | Microservices | NoSQL (MongoDB | NoSQL (MongoDB, Cassandra) | NoSQL MongoDB Cassandra HBase | Orchestration tools | Orchestration tools (Airflow) | Performance optimization | Pipeline Development | Python | SQL | Snowflake | Stone Branch | Tableau | Tools (Airflow | Version Control (Git) | Version control
Education
Roles
Related jobs
-
Senior SAP Datasphere Engineer USD 135K-165KAI Automation | APIs | Automation Scripting | BI platforms | BW on HANA401k | Dental benefits | Disability insurance | Life insurance | Medical benefitsSenior-level Full TimeMinneapolis, MN, United States10h ago
-
Senior Software Engineer (US) USD 185K-200KAI tools | AWS | Big Data | Big data analytics | Data analytics401k match | Flexible hours | Flexible vacation | Learning reimbursement | Parental leaveSenior-level Full TimeNew York R11h ago
-
AI infrastructure | C# | C++ | Cloud infrastructure | Distributed SystemsAdoption Assistance | Dental insurance | Flexible vacation | Medical insurance | Paid HolidaysSenior-level Full TimeAustin, TX, United States12h ago
-
Senior Principal Software Engineer, AI Infra Compute USD 96K-251KAPI Design | API Security | Bash | C# | C++401k | Adoption Assistance | Dental insurance | Disability insurance | Flexible spending accountsSenior-level Full TimeAustin, TX, United States13h ago
-
Artificial Intelligence | Cybersecurity | DVC | Data Engineering | Docker401k plan | Dental insurance | Flexible work schedule | Health savings account | Medical insuranceMid-level Full TimeUSA CA San Diego - 53560 …15h ago
-
Cloud Platforms | Deep learning | Distributed Systems | Docker | Evaluation Monitoring401k | Dental insurance | Medical insurance | Paid sick hours | Vision insuranceSenior-level Contract Full TimeRidgefield Park, NJ, United States15h ago
-
Machine Learning Engineer USD 160K-200KAgent Frameworks | BigQuery | Cloud Functions | Cloud GCP | Cloud RunFlexible hours | Health insurance | Remote work | Skill development opportunitiesMid-level Full TimeLos Angeles, CA; Remote (United States) R15h ago
-
Staff Analytics Engineer, Corporate USD 120K-140KCommunication | Dashboard Development | Data Management | Data Modeling | Data Pipeline DevelopmentSenior-level Full TimeSan Francisco, CA15h ago
-
Staff Analytics Engineer, Business Solutions USD 105K-140KAgile | Data Architecture | Data Modeling | Data Quality | Data VisualizationSenior-level Full TimeSan Francisco, CA15h ago
-
Applied AI Engineer - AI Solutions USD 172K-300KAPI Development | Chroma | CrewAI | Data Processing | Deep learningCareer growth opportunities | Equity | Flexible work options | Learning and development opportunitiesMid-level Full TimeNew York City, NY (Hybrid); Redwood … R16h ago
-
Staff Machine Learning Engineer USD 238K-302KC++ | Data Processing | Deep learning | Language Models | Large Language ModelsCompany benefits | Discretionary bonus | Equity incentivesSenior-level Full TimeMountain View, CA, USA17h ago
-
Edge Vision Systems Engineer USD 150K-212KCamera systems | Device provisioning | Docker | Embedded Linux | NetworkingCompetitive salary | Comprehensive benefits | Professional growth opportunitiesSenior-level Full TimeAustin, TX (Onsite)17h ago
-
Data Governance | Data Modeling | Data Warehousing | MPP | MigrationCommunity involvement | Professional training | Remote work flexibilitySenior-level Full TimeIllinois; Massachusetts; New York; North Carolina; …17h ago
-
Senior Software Engineer, Data Platform USD 190K-240KCost Optimization | Data Lakehouse | Data Modeling | Data Quality | Distributed SystemsCareer development | Flexible working | Inclusive cultureSenior-level Full TimeNew York, United States18h ago
-
Resident Solutions Architect - Financial Services USD 180K-248KApache Spark | Azure | Batch Processing | CI/CD | Cloud PlatformsFlexible work hours | Health insurance | Paid time off | Professional developmentSenior-level Full TimeChicago, Illinois18h ago
-
Resident Solutions Architect - Financial Services USD 180K-248KApache Spark | CI/CD | Cloud AWS | Cloud Azure | Cloud GCPCareer development | Health benefits | Remote workSenior-level Full TimeAustin, Texas18h ago
-
Resident Solutions Architect - Financial Services USD 180K-248KAWS | Apache Spark | Azure | CI/CD | Cloud ComputingCareer growth opportunities | Flexible work arrangements | Health benefits | Professional developmentSenior-level Full TimeNew York City, New York18h ago
-
Resident Solutions Architect - Financial Services USD 180K-248KAWS | Apache Spark | Azure | CI/CD | Data ArchitectureFlexible work hours | Health insurance | Professional development support | Remote work optionsSenior-level Full TimeAtlanta, Georgia18h ago
-
Resident Solutions Architect-Public Sector USD 180K-248KAWS | Apache Spark | Azure | CI/CD | Cloud ComputingFlexible work hours | Health benefits | Professional development supportSenior-level Full TimeWashington, D.C.18h ago
-
Resident Solutions Architect-Public Sector USD 180K-248KAWS | Apache Spark | Azure | CI/CD | Cloud ComputingCareer Development Programs | Flexible work hoursSenior-level Full TimeNew York City, New York18h ago
-
Resident Solutions Architect USD 180K-248KApache Spark | CI/CD | Cloud AWS | Cloud Azure | Cloud GCPFlexible work | Health benefits | Professional development supportSenior-level Full TimeMountain View, California18h ago
-
AWS | CI/CD | Data Architecture | Docker | ETLCollaborative team | Competitive hourly rate | Remote workMid-level ContractUnited States R18h ago
-
Data Engineer USD 102K-138KAPI Development | Agile Principles | Big Data | Big Data Analysis | CD pipelinesProfessional growth opportunities | Supportive environmentSenior-level Full TimeBoston, MA18h ago
-
Data Engineer USD 102K-138KAPIs | Big Data | ETL | Git | LinuxProfessional growth opportunities | Supportive work environmentSenior-level Full TimeLos Angeles, CA18h ago
-
Data Engineer USD 102K-138KAPIs | Agile Principles | Big Data | Big Data Tools | CI/CDCollaboration environment | Professional growth opportunities | Supportive workplaceSenior-level Full TimeMiami, FL18h ago