Junior Architect / Senior Data Engineer - Remote
Schaumburg, Illinois, UNITED STATES; REMOTE
R
USD 91K-163K Entry-level Full Time
Tasks
- Build PySpark notebooks and jobs
- Conduct workload assessment capacity planning and cost modeling
- Configure logging auditing and monitoring
- Design and build data pipelines
- Design dimensional models
- Develop ELT workflows with pushdown optimization
- Implement CI/CD for data pipelines
- Implement lakehouse medallion architecture
- Implement slowly changing dimensions and change data capture
- Perform legacy to cloud data migration
- Respond to production incidents for critical pipelines
- Tune distributed SQL workloads
Perks/Benefits
- 401k contribution
- Comprehensive benefits package
- Equity stock purchase
- Incentive and recognition programs
- Remote work flexibility
- Travel up to 10 percent
Skills/Tech-stack
Active Directory | Azure | Azure Active Directory | Azure Automation | Azure Data Factory | Azure Databricks | Azure DevOps | Azure Key Vault | Azure Monitor | Azure Resource | Azure Resource Manager | Azure Synapse | Azure Synapse Analytics | Bash | Bicep | CI/CD | Data Factory | Data Lake | Data Lake Storage | Data Lake Storage Gen2 | Delta Lake | Entra ID | KQL | Key Vault | Log Analytics | Managed Identity | Microsoft Azure | Microsoft Azure Data | Microsoft Azure Data Factory | Microsoft Fabric | Oracle | Parquet | Powershell | Private Endpoint | PySpark | Python | Resource manager | SQL | SQL Server | Service Principal | Snowflake | Structured Streaming | Synapse Analytics | T-SQL | Teradata | Terraform | Unity Catalog | Virtual Network | YAML
Education
N/A
Roles
Language: en
Views: 19
Clicks: 1
Saves: 0
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R29d ago
-
Data Engineer III/Senior (Analytics) USD 130K-170KAnalytics engineering | Azure | CCPA | CI/CD | DORA Metrics401k retirement plan | Dental insurance | Employee stock purchase plan | Health insurance | Life insuranceSenior-level Full TimeIrving, TX, United States R9h ago
-
AI Search | AI Security | AWS | AWS Bedrock | Agent memoryHybrid work | In-person interviewSenior-level Contract Full TimeJersey City, NJ, United States R9h ago
-
Data Architect (Hybrid - St. Paul, MN) USD 130K-174KAccess Control | Azure | Azure Backup | Azure CLI | Azure DataHybrid work | W2 employmentSenior-level Full TimeSt Paul, Minnesota R11h ago
-
Principal AI Engineer – Agentic AI / Generative AI | Irvine, CA (Hybrid) | Contract to Hire | AS A USD 100K-150KAI Agents | API | AWS | Agent systems | CI/CDContract-to-hire | Hybrid workSenior-level Full TimeIrvine, CA R12h ago
-
Senior Data Engineer ID75059 USD 155K-170KAPI Integration | AWS | Apache Airflow | Apache Spark | AvroEducation budget | Exciting projects | Fitness budget | Flexible schedule | MentorshipSenior-level Full TimeBaltimore, United States R13h ago
-
Senior Data Engineer ID75059 USD 155K-170KAPI Integration | AWS | Apache Airflow | Apache Spark | AvroEducation budget | Exciting projects | Fitness budget | Flexible schedule | MentorshipSenior-level Full TimeHouston, United States R14h ago
-
Senior Data Engineer ID75059 USD 155K-170KAPI Integration | AWS | Airflow | Apache Kafka | AvroFlexible schedule | Mentorship | Personalized growth roadmaps | Professional growth | Remote and office optionsSenior-level Full TimeWest Palm Beach, United States R14h ago
-
Senior Data Engineer ID75059 USD 155K-170KAWS | Apache Airflow | Apache Spark | Avro | DuckDBEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapsSenior-level Full TimeBoca Raton, United States R14h ago
-
Senior Data Engineer ID75059 USD 155K-170KAWS | Airflow | Apache Kafka | Apache Spark | AvroFlexible schedule | Mentorship | Office options | Personalized growth roadmaps | Remote work optionsSenior-level Full TimeJersey City, United States R14h ago
-
Senior Data Engineer ID75059 USD 155K-170KAPI Integration | AWS | AWS Glue | Apache Airflow | Apache SparkEducation budget | Fitness budget | Flextime | Mentorship | Personalized growth roadmapsSenior-level Full TimeTallahassee, United States R14h ago
-
Senior Data Engineer ID75059 USD 155K-170KAPI Integration | AWS | Airflow | Apache Spark | AvroFlexible schedule | Mentorship | Office options | Personalized growth roadmaps | Remote work optionsSenior-level Full TimeJacksonville, United States R14h ago
-
Senior Data Engineer ID75059 USD 155K-170KAWS | Airflow | Amazon SageMaker | Amazon SageMaker Studio | Apache SparkEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapsSenior-level Full TimeLos Angeles, United States R14h ago
-
Senior Data Engineer ID75059 USD 155K-170KAPIs | AWS | Airflow | Avro | DuckDBEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapSenior-level Full TimeFort Lauderdale, United States R14h ago
-
Senior Data Engineer ID75059 USD 155K-170KAWS | Airflow | Apache Spark | Avro | DuckDBEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionSenior-level Full TimeChicago, United States R14h ago
-
Senior Data Engineer ID75059 USD 155K-170KAPI Integration | AWS | Apache Airflow | Apache Spark | AvroFlexible schedule | Mentorship | Office options | Personalized growth roadmaps | Remote work optionsSenior-level Full TimeBoston, United States R14h ago
-
Senior Data Engineer ID75059 USD 155K-170KAWS | Airflow | Apache Kafka | Apache Spark | AvroFlexible schedule | Mentorship | Personalized growth roadmaps | Professional growth | Remote and office optionsSenior-level Full TimeAustin, United States R14h ago
-
Senior Data Engineer ID75059 USD 155K-170KAWS | Apache Airflow | Apache Spark | Avro | DuckDBFlexible schedule | Professional growth | Remote and office optionsSenior-level Full TimePort Charlotte, United States R14h ago
-
Senior Data Engineer ID75059 USD 155K-170KAWS | Apache Airflow | Apache Spark | Avro | Big DataFlexible schedule | Mentorship | Remote work options | TechtalksSenior-level Full TimeSan Francisco, United States R14h ago
-
Senior Data Engineer ID75059 USD 155K-170KAPI Integration | AWS | Advanced SQL | Advanced SQL optimization | AirflowFlexible schedule | Mentorship | Office option | Personalized growth roadmaps | Remote work optionSenior-level Full TimeAtlanta, United States R14h ago
-
Senior Data Engineer ID75059 USD 155K-170KAPI Integration | AWS | Airflow | Amazon SageMaker | Amazon SageMaker StudioFlexible schedule | Flextime | Mentorship | Office options | Personalized growth roadmapsSenior-level Full TimeOrlando, United States R14h ago
-
Senior Data Engineer ID75059 USD 155K-170KAWS | Airflow | Apache Spark | Avro | DuckDBFlextime | Mentorship | Personalized growth roadmaps | Professional growth | Remote and office optionsSenior-level Full TimeIrving, United States R14h ago
-
Senior Data Engineer ID75059 USD 155K-170KAWS | Apache Airflow | Apache Spark | Avro | Columnar StorageEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapsSenior-level Full TimeTexas City, United States R14h ago
-
Senior Data Engineer ID75059 USD 155K-170KAWS | AWS SageMaker | Airflow | Amazon S3 | Apache SparkFlexible schedule | Mentorship | Office option | Personalized growth roadmaps | Remote work optionSenior-level Full TimeMiami, United States R14h ago
-
Senior Data Engineer ID75059 USD 155K-170KAPIs | AWS | AWS SageMaker | Airflow | AvroEducation budget | Exciting projects | Fitness budget | Flextime | MentorshipSenior-level Full TimeDallas, United States R14h ago