Redshift jobs
we are looking for someone to do performance tuning of our amazon redshift cluster. It takes forever for many of our queries to load so I am looking for someone to analyze the database, make recommendations for better performance and implement the recommendations. You must have extensive experience working with redshift and performance turning. I think we may have to set up star schema. Additionally, i do not want to have it re-load all of the historical data that is unchanged with each time that we run the report Please send me examples of project and let me know when you are free to chat via skype
Scope: Looking to build a slackbot that is able to naturally query AWS (redshift or s3) and return values. Operation: Develop a list of predefined commands on the front end that link to specific sql commands on the backend to return values to a user (e.g what are sales for company X during period Y)
I need someone with experience in setting up Continuous deployments via CircleCI to help set up an Automatic/Continuous deployment process as such: Pull request to be checked against master Test instance of Redshift to be spun up Code to be executed on this test instance Tests set up and executed Code marked as test completed Upon merge into master the code to be automatically deployed into EC2 instance
Hi Esteban, I need similar thing to With different content that I will provide to you. Can you build these types of animations?
...dimensions and 5 Measures > Measures should be shown in Graph and number format > Ability to group and filter by dimensions and drill down on it. > the data would be in AWS redshift database (you may suggest some other DB) This job is more of a proof of concept and once we have the right freelancer we would extend this more and more analyses of this and other data. Include the word Blue Magic in your response and make the case why you are qualified for this job and I would send you a link to more info and the data file. (In order to keep it simple the data is now in CSV format, but would in production be in redshift database that would be getting new rows each day) Would need some demo of this job send to be able to read with tableau reader...
I want to design coupon and deals using WordPress. login information should be store in MySQL/Redshift/PostgreSQL database. Email subscription list also should be store in MySQL/Redshift/PostgreSQL database. Add deals/coupons using WordPress. Website should be responsive. Email unsubscribe thing also we need to do. Meaning when admin send the latest deals and offers to users. Some users will like the offers and some user will not like the offers those users want to unsubscribe the email. we need to implement this feature also. Please check attached png file. we want design like that. Note: I am looking for less rate freelancer. We want to complete this website urgent.
Need expertise using AWS S3, Redshift, SQL
I would like to build a live or close to live data pipeline from Amazon RDS (postgres) instance to Amazon Redshift and would like to get help from someone who has already DONE IT. I am not looking for help with general Amazon RDS or Redshift. I am only interested in applications that have actually done such an integration in real life.
• Architect and maintain our data Infrastructure on AWS, including: • Data Lake (Redshift) • Cluster computing resources (Apache Spark) • Distributed messaging and streaming platforms (Apache Kafka) • Distributed storage (S3) • Design and implement data applications on cluster computing and streaming engines • Design and implement data processing microservices and pipelines • Integrate with our vendors to collect and ingest second-party data into our data lake • Work with data scientists to enhance our software with the latest in machine learning algorithms and predictive models • Collaborate to ensure the integrity and cleanliness of data sources, and to support the requirements of downstream data consumers • Mentor a...
Description - Looking for experienced candidate who can migrate apllications cloud..Please mention your experience with AWS and also mention how many applications you have migrated successfully Skills- VPC,EC2,ELASTIC LB,REDSHIFT,ROUTE53,GLACIER
...Aurora MySQL instance which is appended with data from a crawler daily and a Redshift instance to which formatted data is piped through data pipeline. I have Tableau dashboards connected to RDS and Redshift in turn. What I need to achieve is the following: I wish to set up a slightly customized version of the stack above with RDS Aurora postgresql and a Redshift instance. The Redshift instance should hold the full fact tables and the RDS should hold rollup/aggregate tables of the fact tables in Redshift. The SQL worker should given certain triggers update aggregate tables and run some stores procedures. I may also need some help optimizing Redshift to reduce query execution times if that is within your skill set. Updating
...Aurora MySQL instance which is appended with data from a crawler daily and a Redshift instance to which formatted data is piped through data pipeline. I have Tableau dashboards connected to RDS and Redshift in turn. What I need to achieve is the following: I wish to set up a slightly customized version of the stack above with RDS Aurora postgresql and a Redshift instance. The Redshift instance should hold the full fact tables and the RDS should hold rollup/aggregate tables of the fact tables in Redshift. The SQL worker should given certain triggers update aggregate tables and run some stores procedures. I may also need some help optimizing Redshift to reduce query execution times. Updating of the crawler will be handled by
I should automate a process to load data from Redshift to s3.
I need a redshift developer with 3+ years of experience to help me manage Redshift cluster and write SQL queries to manipulate the data to meet the business requirements.
I need assistance setting up Phython on Windows (dev user) in order to get dbt installed and configured (dbt is from fishtown analytics - custom Jinja extensions). And this will ultimately be used as a compiler, a runner, and a package manager against Redshift (AWS). This part of the overall project will be to help me set it up on my windows machine. I imagine this happening by one on one screen share where I will work with the individual getting to get this setup and configured. Someone with good English speaking skills and knowledge of Phyton.
Looking for someone who is expert in python and familiar in using databases such us Redshift to build few python packages for a very small basic ETL solution to read data from S3 files in Amazon AWS and load to Redshift by applying some transformations on the data. time is very critical and I need this project to be delivered within 5 days. If you need more details on this project you can contact me directly for this.
Create a cloudformation template AND a terraform module that creates the following resources: · An S3 bucket with private default acl · A redshift cluster with IAM role that allows read/write access to the bucket · Input parameters: o Number of nodes o Node type/size o Name of bucket/cluster o Charge Code tag to be applied to all resources o Any other parameters you think are required · Outputs: o Redshift endpoint o S3 bucket ARN o Any other information you think would be useful to have as an output
1)Please provide one (small / medium ) use case of your Hadoop ETL work in detail. 2)f there are some X number of c...performing transformations where is the data? -------------------------------------------------- 4)Please provide one (small / medium ) use case of your work with Spark in detail -------------------------------------------------- 5)Please provide one (small / medium ) use case of your work with Redshift in detail. 6)Did you perform the ETL work? where does the data gets transformed? / While performing transformations where is the data? Or Did you simply load the data from Source to Redshift? 7)What are your Data Sources? How did you get the Data from Source to the AWS environment? 8)Did you use Python? If yes, What was the purpose you use Python for? E...
I am looking for a redshift DWH developer in or around Berlin, who can help me with the local Redshift DWH implementation. Must be able to travel to Berlin occasionally.
...[28/Aug/2017:14:38:47 +0000] "GET /0.4/query?target=%2Be9ChyFL&id=3ac218e5787584c09d96d230ed563ceb267b59f4&nonce=9d33f05fda3a5b0d09d6bf73f4078e9c44673c2d&lang=ru-RU&version=chrome-20170609&auth=c6def3a8b002ecf04e7dd629460161fc516da4f9 HTTP/1.1" 200 1148 "-" "Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/60.0.3112.101 Safari/537.36" 571) - Inserting all the variables above into redshift database (for example 'insert into {table} values('{ip}','{date}','{query}','{target}','{id}')' - This process need to be automatic - once the scripts sees new archive files in the server it immediately start working on. - I need that our dev team to query o...
Only EU and Eastern Europe Applicants please! All others will not be considered no matter how great the skills are. Need a python developer with a good knowledge of SQL. Ideal candidate will have the following skills and experience. - Python usage for ETL/ELT - Python usage for API (Amazon, Shopify, Facebook, Google etc.) - Experience with either Redshift, Postgres, MongoDB - AWS experience Additionally, experience with Talend is a plus.
# Overview Alooma is a data pipeline as a service, enabling companies to rely on Alooma as a core data engineering platform to answer all of its data integration challenges. A very common use case of Alooma is to collect events generated by mobile applications, transform them into a uniform, tabular format, and load them to a cloud data warehouse like Amazon Redshift or Google BigQuery. In order to stay compatible with existing industry standards, Alooma forked existing code libraries from Mixpanel, the mobile analytics company, and made some minimal modifications to enable developers to conveniently use them in their code, sometimes alongside existing mixpanel libraries. Recently, adoption of the Alooma version of these SDKs has grown, and with it, the demand for simplicity ...
This is one of my project, and I also do many film 3D design works. I'm a senior level modelling and really good at Excellent skills with MAYA/ Zbrush/ Substacnce Painter/ RedShift/ Mari/ MarvelousDesigner/ Unfold 3D/ Quixel/ Mudbox/ Vray/ Arnold/ Photoshop
Candidate must be a freelancer, available to start working in the next 2 to 3 weeks on full time basis (8 hrs a day). The project duration is 3 months with good chances o...with good chances of becoming a permanent position depending on the project results. The project is a database migration. The existing infrastructure has been developed with real-time application databases in mind, not data analysis. Queries were initially run on a ‘production follower’ and later, as the need for data analysis grew, first on a separate database and more recently on a dedicated Redshift data warehouse that contains a subset of the application data, stored in a different schema. As a result, data consumers have to query up to three different databases for analysis, with a different ...
Looking for someone with experience installing Snowplow analytics software. You will install Snowplow Software in an AWS enviroment and you'll: 1. Setup a Snowplow Collector 2. Setup a Snowplow Tracker and/or Setup a Third-Party Webhook 3. Setup Enrich 4. Setup alternative data stores (e.g. Redshift, PostgreSQL) 5. Set up Data modeling in Redshift or database selected and set up on point 4 6. Set up environment in order we can Analyze our data! We have some things installed and set up (Vagrant, Virtual environment, Snowplow, Snowplow collector and Snowplow trackers) you can start from this point in this case you'll start in point 3 or maybe it's needed to be installed from the beginning.
Candidate must be a freelancer, available to start working in the next 2 to 3 weeks on full time basis (8 hrs a day). The project duration is 3 months with good chances...with good chances of becoming a permanent position depending on the project results. The project is a database migration. The existing infrastructure has been developed with real-time application databases in mind, not data analysis. Queries were initially run on a ‘production follower’ and later, as the need for data analysis grew, first on a separate database and more recently on a dedicated Redshift data warehouse that contains a subset of the application data, stored in a different schema. As a result, data consumers have to query up to three different databases for analysis, with a different sy...
Candidate must be a freelancer, available to start working in the next 2 to 3 weeks on full time basis (8 hrs a day). The project duration is 3 months with good chances...with good chances of becoming a permanent position depending on the project results. The project is a database migration. The existing infrastructure has been developed with real-time application databases in mind, not data analysis. Queries were initially run on a ‘production follower’ and later, as the need for data analysis grew, first on a separate database and more recently on a dedicated Redshift data warehouse that contains a subset of the application data, stored in a different schema. As a result, data consumers have to query up to three different databases for analysis, with a different sy...
Hello there. I am looking to create a series of 3d animations ideally using Maya. These must be high quality (almost photorealistic) for my dental surgery. The project will ONLY be awarded to a freelancer who uses Redshift.
You'll be asked to create Props to be compatible with (Autodesk Maya 2016, and Redshift 2.0.76) - Designs should be driven from Provided concept art, A spin of your own creativity is welcomed. - Models need to have Color, speculator, Normal, Displacement in 4K maps delivered with the Maya File. - if created with Z-brush, you need to provide the Z-brush files compatible with (ZBrush 4R7 P3). - Each prop have a different Maya File, Real world Scale. Props to be Created : - 2 different looking chairs - A Table ( need to have a half sphere curved into it where you roll the Dice in ) - Chess set - door - Red Dice - A key, and a key Chain. - Tillable wooden floor The general look is rough, dirty and old, so keep that in mind. Show samples, Happy bidding !
Need to develop a web application to upload text data file from desktop to amazon AWA S3. Also on the web application user can copy data from AWS S3 to AWS redshift. To finish this project, the developer should know AWS S3 and redshift very well. Also, the developer should know how to develop web application in Java or python with user login function.
*** NO AGENCIES *** I have a 30 million record mongodb database... when i make a query for example keyword search, its really slow and even timesout. I need a big data solution that can return query results in seconds. I am considering using a service like RedShift. So experience with RedShift is a plus
...all the categories and flows, solve for scale and work on internally build services to cater to our growing needs. We love to build well-abstracted modules and services – seeing ourselves as a platforms team that gives our product and engineering the wings they need to fly high. #javascript #swift-ios #java-android #reactjs #nodejs #expressjs #ejabberd-chat #mongodb #redis #postgresql #redshift #python #scala Job Requirements Hustler, with a strong can do mentality, who is joining us to build on a vision, not to do a job Minimum Bachelors in Computer Science from top-tier engineering school 3+ years experienced engineer who is comfortable building beautiful cross-platform experiences History and familiarity with server side development of APIs, databases, ...
HI. I need the following work to be done. 1. upload data from S3 to redshift 2. use AWS Lambda create REST web service for redshift table/data 3. register/ config web service in AWS api gateway what's your quote for this work?
I would like to build Windows version of application (). To achieve this I would prefer to build it with some open source. In this link , I found following windows version applications similar to f.lux. -Redshift -Turn Off the Lights for Desktop So before bid download any of above windows version software and build it. If build is successfull then place your bid. Answer following questions while placing your bid. So please let me know how you would go for this? Have you worked in similar application before? What would be your fixed price quotation for this?
~~~~~~~~~Duties~~~~~~~~~ - Architect a series of microservices based on business logic. - Code them in js/node.js as microservices - Help set up AWS and/all related services/ Database ETC/ REDSHIFT - Upload them to AWS - Test the microservices thoroughly - Aid in integration ~~~~~~~~~~~~~~~ TO QUALIFY ~~~~~~~~~~~ - Must speak good english - Must have clear understanding of MOST AWS services and experience using them in production - Must be extremely proficient in Javascript 5+ years - Experience in production level database architecture in large scale applications is a +
We require a developer to create a Data Export Utility as a component of our Data Processing System. The solution will be a turnkey configurable system which allows n clients to configure daily, weekly and monthly exports in csv format plus adhoc data requests. Data is currently stored on AWS Redshift and S3. The utility requires an Interface to configure exports and a scheduler based system to run each of the required exports. The first stage of our project will be to create file export utility using Dropbox API V2 followed by export options for FTP, email and via API endpoints. The successful applicant will work with our internal Project Manager to agree deliverables and timelines. They must be able to communicate in spoken and written English. Additional Skills: AWS S3, s...
This project is to analyze historic stock data using various parameters and filters. Data includes historical stock prices (intraday by minute) for all stocks since 1998. Help is needed to: 1. Identify the best fit technical solution (AWS, Redshift, Quicksight, Google Big Query, Google Data Studio, Tableau, Pyramid Analytics, etc) to handle data set and analysis at a low cost. 2. Prepare data (data cleanse, load, validation, create calculated fields, etc) 3. Build analysis and reporting solution based on design requirements See attached document for additional details and report example.
I would like to build Windows version of application (). To achieve this I would prefer to build it with some open source. In this link , I found three windows version similar following applications. -Redshift -Turn Off the Lights for Desktop I downloaded windows version VC++ source code from When tried to build getting some compilation error. So please let me know how you would go for this? Have you worked in similar application before? What would be your fixed price quotation for this?
Write a python boto3 script to get a list of aws environment such as EC2,S3,RDS,Lambda,RedShift,Vpc's,Autoscaling,ELB,SNS,SQS,Cloud Formation along with launch time and owner of the resource
- Interface with data from clients, with upwards of a terabyte of data (SQL technologies). - Build out our data pipe, aggregating data from both structured and unstructured sources (Hadoop, Spark, HDFS, EMR, Redshift). - Scale and optimize our client facing data warehouse that provides real-time interactivity across millions of rows of data (Redshift, Elasticsearch). - Lead development of statistical models and predictive technology to improve our experimentation and segmentation tooling (Machine learning, D3). - Develop critical features to in our python software stack.
Create a copy command for a file which is in JSON in S3 by using the JSONPATH manifest file and also the DDL to load the file which needs to be loaded in Amazon Redshift. Sample JSON file will be shared separately to the shortlisted developers. Need to be done in the next 24 hours. Experts ONLY.
Need to populate a table in an web app with data from AWS Redshift. We need to turn any requested data into json and deliver that on the web app's table through websockets. Not too complicated if you're familiar with node.js or alternative messaging approaches. Let me know if you have any questions.
I need you to develop nodejs code to use amazon aws cloud sdk - specifically amazing aws lambda cloud service and other aws services like s3, dynamodb, redshift with nodejs sdk software from official documentation. I would like this software to be developed .
I need you to develop some software for me. I would like this software to be developed . Experience on Amazon EMR and Redshift.
We are looking for help to load data from Staging tables to Star schema inside Amazon Redshift. Currently data is sitting redshift tables .We need a flexible process to automate dimension and fact build. Current Stack : EC2 Windows, S3 ,Amazon Redshift , SQL Server Integration Services . Working Data size: 200GB; Please Bid on this ONLY if you have work experience in building Data warehouse in Amazon Redshift.
...records, regulatory agencies reports, and social media posts. Further, all this data is processed by the cutting-edge Natural Language Processing (NLP) algorithms which are able to produce structured insights which can be then used for advanced analysis. Requirements: Master degree in Mathematics, Physics, Computer Science or similar field(s) Strong Analytical skills Google Big Query/Amazon Redshift, Hadoop/Mongo, Hive/Pig/SQL Familiarity with OOP and Java 4+ Years database programming/engineering experience 2+ Years Big Data engineering experience Experience with strong machine learning component. Experience with multinational organization Online advertising experience — preferred Understanding of mobile, tablet, smart TV platforms Written and oral English ...
Is there any way to load data from redshift to salesforce using python,please provide some sample code am new to python scripts.
