Data Engineer II
Tasks
- Apply data quality best practices
- Build Data Integration solutions
- Collaborate with BI and data science teams
- Design data models and schemas
- Design data pipelines
- Develop data warehouses and data lakes
- Implement ETL and ELT mappings
- Maintain data governance requirements
- Optimize pipeline performance
- Perform unit, integration, and system testing
- Transform and validate data
Perks/Benefits
- N/A
Skills/Tech-stack
API Integration | AWS Glue | AWS Lambda | AWS Redshift | Alteryx | Amazon DynamoDB | Amazon EC2 | Amazon EMR | Amazon Kinesis | Amazon S3 | Apache Kafka | Apache Spark | Apache Spark Streaming | Cause analysis | Continuous Integration and Deployment | Continuous integration | Data Governance | Data Lakes | Data Modeling | Data Pipelines | Data Processing | Data Quality | Data Warehousing | Data integration | Database Design | Databricks | ELT | ETL | Hadoop | Informatica | Integration and deployment | Kafka Streaming | MS SQL | Non-relational | Non-relational Databases | PostgreSQL | Python | Relational databases | Root Cause Analysis | Root cause | SSIS | Scala | Schema Design | Snowflake | Spark Streaming | Streaming Data | Streaming data processing | System Testing | Talend | Testable Code | Unit Testing
Education
Roles
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R29d ago
-
Data Engineer III/Senior (Analytics) USD 130K-170KAnalytics engineering | Azure | CCPA | CI/CD | DORA Metrics401k retirement plan | Dental insurance | Employee stock purchase plan | Health insurance | Life insuranceSenior-level Full TimeIrving, TX, United States R10h ago
-
AI Search | AI Security | AWS | AWS Bedrock | Agent memoryHybrid work | In-person interviewSenior-level Contract Full TimeJersey City, NJ, United States R11h ago
-
Data Architect (Hybrid - St. Paul, MN) USD 130K-174KAccess Control | Azure | Azure Backup | Azure CLI | Azure DataHybrid work | W2 employmentSenior-level Full TimeSt Paul, Minnesota R12h ago
-
Principal AI Engineer – Agentic AI / Generative AI | Irvine, CA (Hybrid) | Contract to Hire | AS A USD 100K-150KAI Agents | API | AWS | Agent systems | CI/CDContract-to-hire | Hybrid workSenior-level Full TimeIrvine, CA R13h ago
-
Senior Data Engineer ID75059 USD 155K-170KAPI Integration | AWS | Apache Airflow | Apache Spark | AvroEducation budget | Exciting projects | Fitness budget | Flexible schedule | MentorshipSenior-level Full TimeBaltimore, United States R15h ago
-
Senior Data Engineer ID75059 USD 155K-170KAPI Integration | AWS | Apache Airflow | Apache Spark | AvroEducation budget | Exciting projects | Fitness budget | Flexible schedule | MentorshipSenior-level Full TimeHouston, United States R15h ago
-
Senior Data Engineer ID75059 USD 155K-170KAPI Integration | AWS | Airflow | Apache Kafka | AvroFlexible schedule | Mentorship | Personalized growth roadmaps | Professional growth | Remote and office optionsSenior-level Full TimeWest Palm Beach, United States R15h ago
-
Senior Data Engineer ID75059 USD 155K-170KAWS | Apache Airflow | Apache Spark | Avro | DuckDBEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapsSenior-level Full TimeBoca Raton, United States R15h ago
-
Senior Data Engineer ID75059 USD 155K-170KAWS | Airflow | Apache Kafka | Apache Spark | AvroFlexible schedule | Mentorship | Office options | Personalized growth roadmaps | Remote work optionsSenior-level Full TimeJersey City, United States R15h ago
-
Senior Data Engineer ID75059 USD 155K-170KAPI Integration | AWS | AWS Glue | Apache Airflow | Apache SparkEducation budget | Fitness budget | Flextime | Mentorship | Personalized growth roadmapsSenior-level Full TimeTallahassee, United States R15h ago
-
Senior Data Engineer ID75059 USD 155K-170KAPI Integration | AWS | Airflow | Apache Spark | AvroFlexible schedule | Mentorship | Office options | Personalized growth roadmaps | Remote work optionsSenior-level Full TimeJacksonville, United States R15h ago
-
Senior Data Engineer ID75059 USD 155K-170KAWS | Airflow | Amazon SageMaker | Amazon SageMaker Studio | Apache SparkEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapsSenior-level Full TimeLos Angeles, United States R15h ago
-
Senior Data Engineer ID75059 USD 155K-170KAPIs | AWS | Airflow | Avro | DuckDBEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapSenior-level Full TimeFort Lauderdale, United States R15h ago
-
Senior Data Engineer ID75059 USD 155K-170KAWS | Airflow | Apache Spark | Avro | DuckDBEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionSenior-level Full TimeChicago, United States R15h ago
-
Senior Data Engineer ID75059 USD 155K-170KAPI Integration | AWS | Apache Airflow | Apache Spark | AvroFlexible schedule | Mentorship | Office options | Personalized growth roadmaps | Remote work optionsSenior-level Full TimeBoston, United States R15h ago
-
Senior Data Engineer ID75059 USD 155K-170KAWS | Airflow | Apache Kafka | Apache Spark | AvroFlexible schedule | Mentorship | Personalized growth roadmaps | Professional growth | Remote and office optionsSenior-level Full TimeAustin, United States R15h ago
-
Senior Data Engineer ID75059 USD 155K-170KAWS | Apache Airflow | Apache Spark | Avro | DuckDBFlexible schedule | Professional growth | Remote and office optionsSenior-level Full TimePort Charlotte, United States R15h ago
-
Senior Data Engineer ID75059 USD 155K-170KAWS | Apache Airflow | Apache Spark | Avro | Big DataFlexible schedule | Mentorship | Remote work options | TechtalksSenior-level Full TimeSan Francisco, United States R15h ago
-
Senior Data Engineer ID75059 USD 155K-170KAPI Integration | AWS | Advanced SQL | Advanced SQL optimization | AirflowFlexible schedule | Mentorship | Office option | Personalized growth roadmaps | Remote work optionSenior-level Full TimeAtlanta, United States R15h ago
-
Senior Data Engineer ID75059 USD 155K-170KAPI Integration | AWS | Airflow | Amazon SageMaker | Amazon SageMaker StudioFlexible schedule | Flextime | Mentorship | Office options | Personalized growth roadmapsSenior-level Full TimeOrlando, United States R15h ago
-
Senior Data Engineer ID75059 USD 155K-170KAWS | Airflow | Apache Spark | Avro | DuckDBFlextime | Mentorship | Personalized growth roadmaps | Professional growth | Remote and office optionsSenior-level Full TimeIrving, United States R15h ago
-
Senior Data Engineer ID75059 USD 155K-170KAWS | Apache Airflow | Apache Spark | Avro | Columnar StorageEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapsSenior-level Full TimeTexas City, United States R15h ago
-
Senior Data Engineer ID75059 USD 155K-170KAWS | AWS SageMaker | Airflow | Amazon S3 | Apache SparkFlexible schedule | Mentorship | Office option | Personalized growth roadmaps | Remote work optionSenior-level Full TimeMiami, United States R15h ago
-
Senior Data Engineer ID75059 USD 155K-170KAPIs | AWS | AWS SageMaker | Airflow | AvroEducation budget | Exciting projects | Fitness budget | Flextime | MentorshipSenior-level Full TimeDallas, United States R15h ago