Consultant / Sr. Consultant - Senior Software/Cloud Architect
United States - Remote
Fresh Gravity
Fresh Gravity is a niche business and technology consulting firm. We help our clients drive digital success to improve outcomes! We focus on Data Management, Data Science/Analytics, Artificial Intelligence, and APIs.Founded in 2015 and rapidly expanding, Fresh Gravity (www.freshgravity.com) is an exciting business and technology consulting company that is at the cutting edge of digital transformation. We drive digital success for our clients by enabling them to adopt transformative technologies. We provide a range of services: from Data Management, Data Science & Analytics, to API Management/Integration and Artificial Intelligence.
In a short time, we have crafted an exceptional team who have delivered impactful projects for some of the largest corporations in the world. We are on a mission to solve the most complex business problems for our clients using the most exciting new technologies. And we are looking for top talent to join us in our quest.
Fresh Gravity’s team members are authorities in their field, but know how to have fun, too. We’re building an inspiring, open organization you’ll take pride in. We challenge ourselves to grow – every day. We create value for our clients and partners – every day. We promise rich opportunities for you to succeed, to shine, to exceed even your own expectations.
We are thoughtful. We are engaged. We are relentless. We are Fresh Gravity.
Fresh Gravity is an equal opportunity employer.
We are seeking a highly skilled Senior Software/Cloud Architect to take on a hands-on role in architecting and building a data pipeline in AWS Glue using NetworkX graph algorithms. While expertise in NetworkX is not required, strong software engineering and cloud architecture experience are essential. The ideal candidate will have a deep background in software development, experience designing and coding high-quality commercial software, and a strong grasp of data engineering concepts.
Requirements
Key Responsibilities Include:
- Architect and develop data pipelines in AWS Glue, leveraging PySpark and Iceberg.
- Design and implement high-performance software solutions, ensuring scalability, reliability, and testability.
- Write, review, and maintain clean, well-documented, and well-tested code (unit, integration, functional).
- Work with big data tools (Spark/PySpark) to process and transform large datasets efficiently.
- Develop and optimize data warehouses, data lakes, and ETL pipelines, handling both traditional code-based ETL and modern big data architectures.
- Utilize SQL and Python extensively to develop efficient data solutions.
- Implement concurrent programming where necessary—experience working with semaphores, threading, and parallel execution.
- Demonstrate strong Linux/Bash CLI skills, including the ability to write complex Bash scripts without relying on external references.
- Administer personal Linux/EC2 environments, ensuring system stability and performance.
- Utilize AWS core services effectively, including Glue, S3, Lambda, IAM, and networking components.
- Lead and collaborate with a team of engineers, navigating challenging team dynamics and providing technical mentorship.
Must haves and Qualification Requirements:
- 8+ years of professional software development experience, with a focus on building commercial-grade applications.
- Strong programming skills across multiple languages, with Python and SQL being the primary focus.
- Hands-on experience with concurrent programming concepts and implementation.
- Proven experience with big data architectures, including Spark/PySpark in AWS Glue.
- Proficiency in Linux administration and Bash scripting (ability to write advanced scripts without external references).
- Expertise in AWS services, particularly Glue, PySpark, Iceberg, and S3.
- Strong problem-solving and debugging skills, with a deep understanding of data structures, algorithms, and performance tuning.
- Ability to work effectively in a highly technical team and provide leadership when needed.
Nice to have:
- Experience in network graph algorithms (NetworkX or similar) is a plus but not required.
- Prior experience leading teams and working with challenging personalities in a fast-paced environment.
- Exposure to CI/CD pipelines, DevOps practices, and infrastructure as code.
Benefits
In addition to a competitive package, we promise rich opportunities for you to succeed, to shine, to exceed even your own expectations. In keeping with Fresh Gravity’s challenger ethos, we have developed the 5Dimensions (5D) benefits program. This program recognizes the multiple dimensions within each of us and seek to provide opportunities for deep development across these dimensions. Enrich Myself; Enhance My Client; Build my Company, Nurture My Family; and Better Humanity.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: APIs Architecture AWS AWS Glue Big Data CI/CD Consulting Data management Data pipelines DevOps EC2 Engineering ETL Lambda Linux Pipelines PySpark Python Spark SQL
Perks/benefits: Career development
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.