amazon-web-services,amazon-cloudformation , How to add multiple instances to an Amazon VPC using AWS CloudFormation without auto scaling?

How to add multiple instances to an Amazon VPC using AWS CloudFormation without auto scaling?


Tag: amazon-web-services,amazon-cloudformation

I am playing around with AWS CloudFormation and I have it working with creating a single instance and in another manifest it working with auto scaling however I don't quite need the full power of autoscaling. is it possible to add a param to say I want X amount of instances and it just adds that amount into the VPC with all the relevant metadata ?


Sure you can.

There is no "NumberOfInstance" property, so you have to just create multiple resources with the type AWS::EC2::Instance and assign them to your subnets inside your VPC.


How can I retrieve all the values from a particular column in amazon DynamoDB?

For example, if my Question table has columns question_id, options,timestamp, I must retrieve all the values of only 'question_id'. Is it possible?...

Use case HBase on EMR

I read the documentation on AWS, but a point is still unclear. Is S3 the primary storage of EMR cluster? or does the data are in EC2 and S3 is just a copy? In the doc : "HBase on Amazon EMR provides the ability to back up your HBase data...

Secure file upload directly to s3 or server to s3 (from iOS app) [closed]

I need to upload sensitive images to s3 from an iOS app. I'm wondering which option is better: Upload to my server first, then upload to s3. Upload to s3 directly, then upload metadata to my server. ...

AWS RDS on Eclipse

I know this question seems a repeat, but it's not and I have tried all the solutions I could find PROBLEM: I am running an AWS RDS instance for the database. It works fine when I connect to it using AWS EC2 instance(uses linux) but when I try it with...

Best Way to Limit Groups of HITs to One Worker Per Any HIT Included in the Group?

I would like to limit a group of MTURK HITs such that if a worker has taken any previous HIT included in the group, he or she cannot take any future hits included in the group. I have seen two distinct methods of doing this described here on StackOverflow. Use...

How can I know the database url of AWS EC2 MySQL?

I would like to import gtfs files into mysql by using a tool from github, runing the follwoing command: gtfsdb-load --database_url <db url> <gtfs file | url> How can I get the database_url of mysql located in AWS EC2?...

View EC2 Instance Server Files in AWS Console

Is it possible to browse server files (.php, etc.) inside the AWS Console (in the browser) and not via a SSH or FTP client? For example; view files just like in CPanel on a regular web host. I am working on a EC2 instance of a Debian OS that was...

How to configure aws CLI to s3 cp with anonymous user

I need to download files recursively from a s3 bucket. The s3 bucket lets anonymous access. How to list files and download them without providing AWS Access Key using an anonymous user? My command is: aws s3 cp s3://[email protected]/pavlo/text/tiny/rankings/uservisits uservisit --region us-east --recursive The aws compains that: Unable to locate...

How do I SSH into EC2 with .pub?

When I create a new Elastic Beanstalk environment it asked me if wanted to create a new keypair. I say yes, and it created two file in my .ssh folder locally called app and Normally to ssh into an instance I use a app.pem file. i.e ssh -i app.pem...

Xcode + AWS Integration Apple Mach-O Linker Error

I have a very simple Xcode project that I started and am now trying to integrate the Amazon Web Service (AWS) SDK into my project. I followed the instructions posted on their instruction page and everything looks good EXCEPT that I've got the following output... duplicate symbol _OBJC_CLASS_$_XMLDictionaryParser in: /Volumes/Macintosh...

Error with not existing instance profile while trying to get a django project running on AWS Beanstalk

I`m trying to deploy a django project to AWS Beanstalk following this tutorial. I executed eb create and after a while I get the error The instance profile aws-elasticbeanstalk-ec2-role associated with the environment does not exist. I`m new to the Amazon cloud and can not interprete this error. Can somebody...

Error when using AWS-SDK-GO (NoCredentialProviders: no valid providers in chain)

I've recently started using the aws-sdk-go package. Walking through the instructions, my folder structure is as follows: bin/ , pkg/ (as always) src/ app/main.go (code taken from the docs) Now when I run go install, and then execute the app.exe (using windows here), I'm getting the following error: panic:...

Amazon EC2 Storage lacks

I have launched Amazon EC2 instance of "m3.large" type. According to this page, m3.large should have 2vCPUs, 7.5GiB Memory and 1x32GB SSD Storage. But df -ah returns following results. It seems that the instance lacks the volume. Filesystem Size Used Avail Use% Mounted on /dev/xvda1 7.9G 797M 6.7G 11% /...

Deleting Data from DynamoDb Table automatically

Is there any kind of life retention period concept in DynamoDB. I mean is there any way such that data inside a table will be deleted after some time like we can set some retention period in S3. Thanks,...

How to find Unused Security Groups of all AWS Security Groups?

How to find all the used security groups attached with all the aws resources using Boto? Currently the following script which is giving only ec2 instances- sec_grps = ec2_conn.get_all_security_groups() for group in sec_grps: print group, " Instances attached ", group.instances() Is there any way to get all security groups which...

Gradle Compilation Errors when adding 'com.amazonaws:aws-java-sdk:1.10.1'

I am running Android Studio and my app has been running perfect until I do the following. When I add "compile 'com.amazonaws:aws-java-sdk:1.10.1'" to my gradle file, I get the following warnings when I do a project re-build. Warning:Dependency commons-logging:commons-logging:1.1.3 is ignored for debug as it may be conflicting with the...

“client not initialized” error when using SSMCache with AWS elasticache autodiscovery

I am using Spring cache with AWS elasticache provider. I get this warning: WARN c.g.code.ssm.spring.SSMCache - An error has occurred for cache defaultCache and key java.lang.IllegalStateException: Client is not initialized at net.spy.memcached.MemcachedClient.checkState( ~[elasticache-java-cluster-client.jar:na] at net.spy.memcached.MemcachedClient.enqueueOperation( ~[elasticache-java-cluster-client.jar:na] at net.spy.memcached.MemcachedClient.asyncGet(

How to route traffic by proximity from Route 53 to closest NGINX server?

I'm trying to set up a web server stack in the following way: Use Route 53 for my DNS Serve static content with Cloudflare from S3 buckets Route API calls to nearest NGINX server that sits in front of some Nodejs servers. So all static content is done easily enough...

Should I instantiate an object every request or once upon app launch?

In my Rack app, I need to use an AWS Cognito Client for signup & login requests. Should I initialize: a separate client (assigned to a local variable inside the call method) for each request? one client (assigned to a global variable outside the call method) for all requests? Concerns:...

Polling Continuously from a SQS queue on AWS

I have a java class that connects to an SQS queue and I would like it to respond to messages that are sent to the SQS queue. Is that possible without running the java class continuously, sending receiveMessageRequests?

DynamoDB Conditional Check Fail Monitoring

I have used dynamodb-session to set DynamoDB for Session state provider. In my ASP.NET_SessionState table in DynamoDb There is "Conditional CheckFailed " monitoring. My question is: In what condition these exceptions happen and how can I reduce them?...

Call to S3Client::setRegion() fails

I'm using "aws/aws-sdk-php": "3.0.3" via composer to access some S3 buckets in different regions, but I can't seem to get S3Client to change regions using the setRegion() function without it generating the error: PHP Catchable fatal error: Argument 2 passed to Aws\AwsClient::getCommand() must be of the type array, string given,...

how to use AWS cognito with custom authentication to create temporary s3 upload security token

So I'm a bit confused by the Amazon documentation on Cognito concerning one of their stated use cases: "use your own identity system... allowing your apps to save data to the AWS cloud". In my case I want to give them aws tokens to upload directly to s3 from the...

Getting Blank messages in my app from AWS SNS.

I want to send push notification to individual using android GCM. have created the app in SNS. I am using aws-sdk v1.4 for Ruby. When I send through Amazon web interface I receive the messages, but When I publish it through using the code below, I get blank messages. what...

Amazon DynamoDB Mapper - limits to batch operations

I am trying to write a huge number of records into a dynamoDB and I would like to know what is the correct way of doing that. Currently, I am using the DynamoDBMapper to do the job in a one batchWrite operation but after reading the documentation, I am not...

PHP: Secure a Rest Service with a Token mixed with Timestamp

I have a rest service that my website calls it and I want to secure it from calling outside of my website as much as possible. I want to create a token mixed with timestamp, so the user can only call the service in 10 minutes (for example) with the...

Which is a better way: retrieve images from AWS S3 or download it and store locally in a temp folder to be displayed?

Problem: Retrieve image from S3 and load into UIButton. I'm currently doing my research on this issue and can't seem to make up my mind. Which is a better way to do it in terms of performance and security issue? Also, do I need to do caching or store these...

ajax GET request times out for URL when browser and CURL work

I see one similar question but it does not have an accepted response. The following ajax request times out. But GET request on the same URL using browser or curl work fine. Note this is a cross domain AJAX since the code sits on a different server and URL is...

Using Java web service on Amazon cloud

I want to make a web service in java which will take arguments and do processing and return a json response. I am not been able to figure out how to deploy this service on amazon ie (on ec2 or some where else) . what will be the url to...

Keep config file secure using github and Elastic Beanstalk?

I am using github (public) to keep track of my web app and about to deploy it to Elastic Beanstalk. Is there a good way to keep my config file secure which has RDS username/password? I have to add the file to git in order to push it to Elastic...

Use Reserved instance and autoscaling group

I would like to know if it would possible to create an architecture with both reserved instance (RI) and auto-scaling group to serve web pages. The idea would be to have one RI serving 24/7 and launching on demand instances in an auto-scaling group when the CPU of the RI...

heroku pgbackups:url command is no longer working?

How do I download my dump directly from Amazon AWS S3 if heroku pgbackups:url b004 isn't working? Specifically, when I run this command it returns: ! Please add the pgbackups addon first via: ! heroku addons:add pgbackups And then when I run this command I get: ! No such add-on...

Eclipse not compiling because of ClassNotFoundException

After following an AWS tutorial for Eclipse, my code no longer compiles and runs. I decided to undo what the tutorial told me, so I may have changed some settings that I forgot to unchanged but I really cannot find the root of my problem. Eclipse seems to be back...

Installing Python 3 Docker Ubuntu error command 'x86_64-linux-gnu-gcc

I'm trying to create a dockerfile that uses Python 3. FROM ubuntu:14.04 RUN apt-get update RUN apt-get install -y python3 python3-dev python-pip RUN apt-get install -y libxml2-dev libxslt1-dev libpq-dev libjpeg-dev libfreetype6-dev zlib1g-dev RUN cd /var/projects/apps && pip install -r requirements.txt I get the error fatal error: Python.h: No such file...

“undefined method 'value'” when looping

I am trying to loop through a list of tags returned from AWS API, but I'm getting "undefined method 'value'. I can provide further information if needed. This is my simple loop: @instances.each do |i| t = 0 while i.tags.any? do puts i.tags[t].value t += 1 end end ...

AWS Beanstalk - Passenger Standalone not serving web pages after Rails 4.2.1 migration

My Rails 3.2.21 app was running fine on AWS Beanstalk under Passenger Standalone 4.0.53. I migrated the app to Rails 4.2.1 and got it passing all tests on my local development machine (Ubuntu, WEBrick). I deployed it to Beanstalk (aws.push), the deploy succeeds (copied from /ondeck to /current) and: nothing....

Amazon DynamoDB table w/ Elastic Beanstalk not setting up correct parameters

I have an example Dynamodb project from Amazon that when uploaded to an instance of Elastic Beanstalk environment, generates a Dynamodb table. Howevever, after generating the table is missing a few parameters. Here is the code to the Elastic Beanstalk instance: /* * Copyright 2010-2013, Inc. or its affiliates....

AWS Beanstalk autoscale user files

I have setup AWS Beanstalk instance where a server app is deployed. In the backend users can change files in images/ directory. But when autoscaling the instances, the user files are not mirrored. How to solve this requirement? Can I setup AWS Ec2 to create new AMI each night based...

Configure Dockerfile to set AWS configurations

I've just started looking at Docker. I have a node app that resizes and image and then sends an SQS message to aws when finished. I have managed to create a docker image of my app, copying it from my local machine, but run into the issue that I can't...

Loop through list of AWS-instances shows only first item

I am working on a simple customer frontend for AWS. I want a list of all the users machines for start/stopping the EC2s. While the logic works I can only show the first of the machines in my view. I guess it's related to the AWS APIs pageable response format,...

An illustration of AWS hosted zones and buckets

After more than a few experiments with hosted zones and buckets, it seems I'm getting failures due to unexpired caches even though I may well have set up everything correctly. Before proceeding, I'd like to summarize using two sketches the lengthy (and frankly, tedious) AWS documentation, and ask whether these...

eb cli 3.0 is not putting my settings from my existing environment after connecting it

I created a customized Elastic Beanstalk environment from the web interface with configuration for VPC and other things. I now have a local repo that I want to connect to this created environment. I ran eb init and was able to spot my environment and selected it. I then ran...

How to change the IP address of Amazon EC2 instance using boto library

How can I assign a new IP address (or Elastic IP) to an already existing AWS EC2 instance using boto library.

How to set a variable using dynamic inventory using Ansible

I am looking for method to set a variable in ansible playbook using inventory information received from dynamic inventory. For example if we have a sample playbook like --- - hosts: localhost connection: local tasks: - set_fact: rds_hostname="{{ rds_mysql }}" #set rds endpoint from - debug: var=rds_hostname I am...

Is AmazonSimpleNotificationServiceClient thread-safe?

I'm developing a class library in .NET that uses Amazon AWS SDK to queue notifications with Amazon SNS, as well as to create new mobile push endpoints. You do this by making requests with a client object that you create like this: var client = new AmazonSimpleNotificationServiceClient(...); The ... is...

AWS Elastic beanstalk scale triggering

I set the following parameters in my elastic beanstalk environment: Do you think this settings are reasonable? I didn't understand the breach duration parameter. What does it means? is 5 minutes is reasonable? Thanks...

AWS Kinesis - data source on a third party server

New to AWS Kinesis. We're trying to evaluate whether it makes sense or even possible to place events captured in a log file which is located on a third party server into AWS Kinesis stream, given that we only have a VPN access to this server where the log file...

cloudsearch query to boost exact match on range

In a cloudsearch structured query. I have a couple of fields I am searching on. On field one, the user selects "2" On field two the user selects "1" I am wanting to run this as a range query, so that the results that are returned are -1 to +1...

Why is this python boto S3 multipart upload code not working?

I am trying to upload a 10 GB file to AWS S3, and someone said to use S3 Multipart Upload, so I stumbled upon someone's github gist: import os import sys import glob import subprocess import contextlib import functools import multiprocessing from multiprocessing.pool import IMapIterator from optparse import OptionParser from...

how to uninstall tomcat from AWS linux?

What is the equivalent of sudo yum install tomcat7 tomcat7-webapps but for uninstalling tomcat7? Is there a straight forward method and that leaves no trace behind?