Senior Data Engineer
- Full-time
Company Description
At Viral Nation, we specialize in building social-first ecosystems for brands to connect with the modern consumer journey. Our integrated solutions align strategy, talent, media, and technology with culturally relevant creative to scale the world’s fastest growing digital brands. Viral Nation offers a fluid, creative, and growth-oriented environment that will support your ambitions to apply your talents in an open, collaborative, and fast paced culture. We’re driven to push boundaries and think beyond today to deliver strategies, and we’re just getting started. Our ability to stay at the forefront of the industry has fueled our success and will guide us in paving the path forward.
2021 was a transformational year for Viral Nation, having grown by 200% and we have even bigger ambitions for 2022 and beyond. While we continuously exceed our goals, we need your help – our success is only as great as our people. Strong performance leads to high expectations and we need to keep raising the bar!
Our Values
We Constantly Evolve: Embracing change is both an opportunity and a necessity!
Courage: Challenging the norm drives us forward!
Diversity: We strive for excellence and recognize that our differences make us stronger. We respect and seek out inclusion of differences, realizing we can learn from each other!
Resilience: Adversity is a springboard for growth!
Job Description
Designing, building and maintaining efficient, reusable, and reliable architecture and code.
Participate in the architecture and system design discussions
Independently perform hands on development/coding and unit testing of the applications
Collaborate with the development and AI teams and build individual components into complex enterprise web systems
Work in a team environment with product, frontend design, production operation, QE/QA and cross functional teams to deliver a project throughout the whole software development cycle
Architect and implement CI/CD strategy for EDP
Implement high velocity streaming solutions using Amazon Kinesis, SQS, and Kafka (preferred)
Designing, building and maintaining efficient, reusable, and reliable architecture and code.
Ensure the best possible performance and quality of high scale web applications and services
To identify and resolve any performance issues
Keep up to date with new technology development and implementation
Participate in code review to make sure standards and best practices are met
Migrate data from traditional relational database systems, file systems, NAS shares to AWS relational databases such as Amazon RDS, Aurora, and Redshift
Migrate data from AWS Dynamodb to relational database such as PostgreSQL
Migrate data from APIs to AWS data lake (S3) and relational databases such as Amazon RDS, Aurora, and Redshift
Work closely with the Data Scientist leads, CTO, Product, Engineering, DevOps and other members of the Ai Science teams
Collaborate with the product team, share feedback from project implementations and influence the product roadmap.
Be comfortable in a highly dynamic, agile environment without sacrificing the quality of work products.
Qualifications
Bachelor's degree in Computer Science, Software Engineering, MIS or equivalent combination of education and experience
5+ years of experience as Data application developer
AWS Solutions Architect or AWS Developer Certification preferred
Experience implementing software applications supporting data lakes, data warehouses and data applications on AWS for large enterprises
Solid Programming experience with Python, Shell scripting and SQL
Solid experience of AWS services such as CloudFormation, S3, Athena, Glue, EMR/Spark, RDS, Redshift, DataSync, DMS, DynamoDB, Lambda, Step Functions, IAM, KMS, SM etc.
Solid experience implementing solutions on AWS based data lakes.
Experience in AWS data lake/data warehouse/business analytics/
Experience in system analysis, design, development, and implementation of data ingestion pipeline in AWS
Knowledge of ETL/ELT
End-to-end data solutions (ingest, storage, integration, processing, access) on AWS
Experience developing business applications using NoSQL/SQL databases.
Experience working with Object stores(S3) and JSON is must have
Should have good experience with AWS Services – Glue, Lambda, Step Functions, SQS, DynamoDB, S3, Redshift.
Should have hands-on experience with Python, Django
Great knowledge of Data Science models
Plus to have knowledge on Snowflake
Nice to have:
Solid experience in AWS AI solutions such Recognition, Comperhind and Transcribe
NodeJS, .NetCore, C#, Reactjs, RestAPI, Microservices, Postman, GraphQL, Mongo, Linux, Javascript, HTML5, CSS, Django
Additional Information
Viral Nation is committed to diversity, equity and inclusion in our agency. Viral Nation welcomes applications from people with visible and non-visible disabilities. Accommodations are available on request for candidates taking part in all aspects of the recruiting and selection process.