Senior Data Engineer

YOUR ROLE

To achieve our goals, we are developing a suite of data-centric intelligence products that help us analyse, decide and execute on investment opportunities, as well as track performance on an ongoing basis. Core to these products is a data infrastructure built on AWS/Snowflake that ingests data from 20+ traditional, alternative and proprietary sources.

As a Senior Data Engineer, you will take a crucial role in our growing tech team and will have a real impact on our business decisions. You will further develop our data infrastructure and core products and have the opportunity to work with petabytes of data.

DevOps

• Work with technologies including Docker, Airflow, AWS Codebuild, Code Deploy, Elastic Beanstalk and Github  
• Perform continuous integration/continuous delivery, automated deployment and monitoring
• Create scalable production solutions from prototyped code 

Data and Architecture

• Create data acquisition scripts for various sources (i.e. Web Scraping, External APIs, Custom Sources etc)
• Develop, construct, test and maintain our architecture to support internal research tools
• Discover opportunities for data acquisition
• Create and maintain a fault tolerant, highly available and scalable data architecture on AWS, snowflake etc to support the daily infrastructure needs 
• Create and maintain robust ETL pipelines for market and trade data and alternative data using S3, snowflake, postgres, athena, AWS Glue, Airflow etc.
• Ensure data quality, accuracy, security and performance in all processes  

 Development

• Develop internal tools using various python libraries such as Django, DRF, Pandas, Numpy, SciPy, Plotly etc for data analytics, aggregation and visualisation
• Program APIs for data consumption which consists of data transformations, summarisation and aggregations 
• Mentor other members of the team and help them grow in their skillset 

YOUR PROFILE

• Bachelor’s degree (or higher) in Computer Science or a related field with 5 years of overall experience in software engineering
• You have a deep understanding of the technicalities and limitations of AWS tools. You have experience creating and maintaining and restoring resources on AWS (i.e. Lambda, Cloud Formation, RDS, Elastic Beanstalk, EC2, API Gateway etc.)
• 4+ years of experience with Python (Pandas, DRF, Plotly, Boto3 etc.)
• Advanced level of SQL knowledge
• Well versed with Dockers, GIT and Airflow
• Nice to have previous experience working with Snowflake and Athena
• Nice to have some experience with FrontEnd techs, i.e. React, Bootstrap
• Fluent English

YOUR MINDSET

• You are a team player, seeking to work with entrepreneurial individuals and thrive in a high-performance, transparent culture
• You are self-reflected and it is important to you to constantly grow and learn
• You balance quick results with long-term maintainability and scalability in the software you build
• You execute with ownership, determination and free of politics
• Very high standards for your work, keen attention to detail and willingness to go the extra mile to deliver the best-in-class results

OUR BENEFITS

• The opportunity to work in large environments with petabytes of data  
• An experienced, international team with professional colleagues and strong experts for an inspiring network
• Be one of the first team members in a growing team and make a true impact
• Short decision-making processes and open-door policy - your opinion is important!
• Great freedom in choosing your tasks - we want you to have fun at work and feel comfortable.
• Employee benefits range from a competitive personal development budget, team events to high-end hardware 
• Visa sponsorship and relocation assistance (incl. flat search)