cloud , Google PerfKit tool: Where are the results of the benchmark run stored


Google PerfKit tool: Where are the results of the benchmark run stored

Question:

Tag: cloud

I am trying to use the new google perkit tool. I followed the procedure in https://github.com/GoogleCloudPlatform/PerfKitBenchmarker and trying to run the below command

..\GoogleCloud\Perfkit\PerfKitBenchmarker-0.10.0\perfkitbenchmarker\pkb.py --project=24Feb2015 --benchmarks=ping --machine_type=f1-micro > my.log

I see that my.log is empty. I tried a lot to run individual bencmark python files as well, but unable to see any results.

Can you please help on the below:- 1. Does perfkit itself create VMs on the google cloud and run the benchmark tests specified in --benchmark option above? When I ran the above command, I cudnt see any VM created on google cloud.

  1. Why are my benchmark results empty?

Also was curious about the below:

  1. At present only aws, google, azure cloud providers are supported. What does it take to support other cloud providers?

  2. Right now predefined benchmarks are run, is there a way to include custom benchmark tests also.

(I authenticated my google cloud account, deployed a sample aerospike app).

Thanks a lot! Sushma.


Answer:
  1. Yes it fully provisions the system including creating VM's
  2. Are you running this from a Windows machine? If so are you running inside CYGWIN? See my output from your command below.
  3. We also support static machine (ie anything with an IP). Adding a new provider is not that difficult. We have plans for OpenStack. See the issues on https://github.com/GoogleCloudPlatform/PerfKitBenchmarker
  4. Yes but it takes work to do the automation. Check out the benchmarks directory to see how it is done for various benchmarks today.

When I run on my LINUX machine I see the following: ./pkb.py --project=google.com:voellm --benchmarks=ping --machine_type=f1-micro > my.log 2015-03-16 11:19:23,848 INFO Verbose logging to: /tmp/perfkitbenchmarker/run_5653144d/pkb.log 2015-03-16 11:19:24,087 INFO Preparing benchmark ping 2015-03-16 11:19:24,088 INFO Running: gcloud compute disks create perfkit-5653144d-1 --size 10 --type pd-standard --project google.com:voellm --format json --quiet --zone us-central1-a --image ubuntu-14-04 2015-03-16 11:19:24,088 INFO Running: gcloud compute disks create perfkit-5653144d-0 --size 10 --type pd-standard --project google.com:voellm --format json --quiet --zone us-central1-a --image ubuntu-14-04 2015-03-16 11:19:35,170 INFO Running: gcloud compute disks describe perfkit-5653144d-1 --project google.com:voellm --format json --quiet --zone us-central1-a ...


Related:


Relation replacement in Parse Cloud


javascript,parse.com,cloud
In a Parse Cloud function I need to replace the value of a relation. How do I do that? Here is my code: Parse.Cloud.define (“myCloudFunction”, function(request, response) { // Code to get myObject ……. // ……… // Now I have myObject in the hand. myObject.relation("author").add(NewAuthor); }); If I keep this...

Reading part of a file in S3 using Boto


python,python-2.7,amazon-s3,cloud,boto
I am trying to read 700MB file stored in S3. How ever I only require bytes from locations 73 to 1024. I tried to find a usable solution but failed to. Would be a great help if someone could help me out....

When upload Bitmap stream to Azure storage, it store zero/empty image


asp.net-mvc,azure,cloud
I am using below code to upload a MemoryStream from a bitmap image to my Microsoft azure storage account: MemoryStream memoryStream = new MemoryStream(); img.Save(memoryStream, System.Drawing.Imaging.ImageFormat.Png); blob.Properties.ContentType = model.File.ContentType; blob.UploadFromStream(memoryStream); What happen by use above code is it uploads an empty image to Azure storage :( !(I found the name...

Cloud Foundry with Spring Boot


cloud,spring-boot
I am getting the following error when I am trying to push the Spring Boot application: C:\WORKSPACES>cf push spr_boot_first Creating app spr_boot_first in org k.agwl.org / space development_space_one as [email protected] OK Using route spr-boot-first.cfapps.io Binding spr-boot-first.cfapps.io to spr_boot_first... OK Uploading spr_boot_first... FAILED Error uploading application. read C:\WORKSPACES\.metadata\.lock: The process cannot...

In Spark, does the filter function turn the data into tuples?


mapreduce,apache-spark,cloud
Just wondering does the filter turn the data into tuples? For example val filesLines = sc.textFile("file.txt") val split_lines = filesLines.map(_.split(";")) val filteredData = split_lines.filter(x => x(4)=="Blue") //from here if we wanted to map the data would it be using tuple format ie. x._3 OR x(3) val blueRecords = filteredData.map(x =>...

Spark - How to count number of records by key


hadoop,apache-spark,cloud
This is probably an easy problem but basically I have a dataset where I am to count the number of females for each country. Ultimately I want to group each count by the country but I am unsure of what to use for the value since there is not a...

Grunt, cloud deployment and compiled files


node.js,express,gruntjs,copy,cloud
I've recently started exploring grunt and I've done so by trying out the https://github.com/ng-vu/ng-express-boilerplate seed. It uses a gruntfile to copy static assets, css, javascript to a destination folder with this code: dist_js: { files: [{ src: ['<%= app_files.js %>', '<%= vendor_files.js %>'], dest: '<%= dist_dir %>/public', cwd: '.', expand:...

How to get Office 365 service location via API


api,cloud,office365
I am trying to find the region of an Office 365 service. Microsoft's Office 365 documentation states that the data storage regions are disclosed to the customer. Is it possible to find a service's region via an API request? I've been looking through documentation on the Service Communications API, the...

How to authorize with amazon cloud drive and get the photos of the user from cloud drive?


android,cloud,amazon,drive
I want to authorize user and then want to access user photo that are available on a cloud drive. Kindly guide me how to access user cloud drive in android application and get user photos.

Running python script on Microsoft Azure


python,azure,cloud,bigdata,azure-virtual-machine
I'll have a linux machine with a virtual machine installed for Microsoft azure soon. I need to run some data mining/graph analysis algorithms on the azure because I work with big data. I don't want to use azure machine learning stuff. just want to run my own python code. What...

GoogleCloudMessaging - InstanceID.getInstance(), registering from client


java,android,api,cloud,messaging
I'm pretty new to programming in Java and generally programming. Right now I decided to make my own app that is supposed to utilize Google Cloud Messaging. And somehow I succeeded but then I realized I used method String regid = gcm.register(PROJECT_NUMBER); that is deprecated and I should now use...

Parse.com To Do web app deployment issue


javascript,backbone.js,web,parse.com,cloud
Apologies for basic question. I am very new in web development . I have download parse.com javascript web To Do App from https://parse.com/tutorials/todo-app-with-javascript . Now I want to deploy with parse.com. So that I can browse this app using http://mytestapp.parseapp.com. But when try to deploy using "parse deploy" command getting...

How to visible or invisible tab in FormTab Page


cloud,erp,acumatica
I create a FormTab Page and in some case I need to show or hide tab. I tried PXUIFieldAttribute.SetVisibility in RowSelected Event but It does not work.

How to run background job and keep looking something in parse cloud to perform action


android,parse.com,cloud
Hello I want to keep running one background job always on parse cloud and keep looking such that whenever any row insert in table then I want to perform some operation like send notification to user automatically via that background job. If it is possible then what is way to...

Openstack cloud billing software list


cloud,openstack,saas,billing
I'm searching for a billing software for cloud platforms which should do the following: Be able to show charts and diagrams of total cloud resources consumption (e.g. number of VCPUs, RAM, hard disk and so on) per project and user Be able to calculate the cost of cloud services based...

How to fetch data from parse database in Cloud code


android,parse.com,cloud
Hello I am working on parse project in which I am looking how to fetch data from parse database in Cloud code. https://parse.com/docs/cloud_code_guide#started Here I didn't find a way to fetch data from any class. Is there any way to fetch data from class in cloud code ? If yes...

How to create a secure git repository in the cloud?


git,security,encryption,cloud
I would like to create a git repository and keep a backup copy of it in the cloud. Creating a remote repository would be a simple solution, but the code would be open to anyone with access to the cloud machine, thus compromised. Currently I manage this git repository in...

Adding a second Heroku app to my local repo, I'm denied access to my apps


ruby,git,heroku,cloud,heroku-toolbelt
I originally had a setup like: git remote -v origin [email protected]: (fetch) origin [email protected]: (push) stage [email protected]: (fetch) stage [email protected]: (push) where I could push and pull from stage without an issue and run commands like heroku run console --app stage however, I added a production app locally leaving me...

Running cloudfoundry sample app on local sandbox


cloud,cloudfoundry
This question may seem pretty naive but I've just started using cloud foundry. I installed the eclipse plugin & deployed a sample app. But everytime, while running the app in local or starting the server it is being pushed to the remote cloud server & running on a unique domain...

Authenticate Google Account with php


authentication,printing,cloud
Is there a possibility to log in on to Google Accountt with php? Until 26th of May I was using https://www.google.com/accounts/ClientLogin to verify account. Now this method is disabled. What Im trying to do is to connect Google Printer Cloud to print orders in resaturant. Client makes order on website...

Parse cloud code check for key duplication


parse.com,cloud
I developed an iOS app using Parse. When user sign up, I want to check if his phone number exist. So I write the following Parse Cloud Code: Parse.Cloud.beforeSave(Parse.User, function(request, response) { var toSaveObjectId = request.object.get("objectId"); console.log("UserName: "); console.log(request.object.get('username')); //if (typeof obj.foo != 'undefined') if (typeof toSaveObjectId != 'undefined') {...

Installing CouchDB on IaaS?


cloud,couchdb,centos6,iaas,dbaas
After many many google searches I am still unclear on how to install a CouchDB instance on an Infrastructure as a Service cloud service. I have looked into DBaaS options such as Cloudant, but for initial testing I would like to host the database on an IaaS. Specifically, I am...

Did google change/update related to vm ssl connections to Cloud SQL?


sql,ssl,cloud
Google Cloud SQL down? At 1am ET my VM connection to Cloud SQL over SSL decided to stop connecting and will not allow a connection. Did google make changes/updates? Has been working fine for months, no changes, then all of a sudden this morning at 1am ET BAM! Won't connect...

What does (extra requests) mean in Parse.com services?


parse.com,notifications,push-notification,cloud,push
In Parse's pricing FAQ it is mentioned that "If your app hits its request limit, your extra requests will begin to fail with error code 155 (RequestLimitExceeded)". What does (extra requests) mean? Are they the requests made within the same minute? day? month? or all other requests made until the...

How to save my data in a cloud?


google-drive-sdk,cloud,server,dropbox
I don't know if this is possible, but I would like to save some data of my website, like images and documents in a cloud like dropbox or google drive and I want that these data are available and visible to someone looking my site. is it possible? (My intention...

How to Connect to a Google Cloud SQL Instance from a Different Server


php,mysql,sql,cloud,google-cloud-sql
I need your help! I'm trying to connect to the Google Cloud SQL instance from a different server (ie.,provided through Hostgator) but I am unable to select the Database (which is already created at Google Cloud SQL) using the mySQL function - "mysql_select_db" in order to store and retrieve data...

changing config settings in Azure programmatically


c#,.net,azure,cloud,azure-worker-roles
I am writing a worker role that runs continuously, but I want to store the latest time it has run in a configuration setting that we use to timebox our queries so we run as few as possible. Currently I am storing this date in Azure table storage, but I'm...

How to create a directory on my cloudfoudry account?


lucene,cloud,command-line-interface,cloudfoundry
I deploy to cloudfoundry an application which need a directory for lucene. This application failed to start because there is not the configured directory. I search on Cloundfoundry forums but i did not found how to create a directory on my server on CloudFoundry. If someone have a documentation or...

Writing an IAM policy and CORS configuration for Amazon S3


ruby-on-rails,amazon-web-services,amazon-s3,cloud,amazon-iam
I am very new to all this but have been able to get an avatar/image uploader to work in my Rails application. A user can upload a new avatar to my S3 bucket and the avatar shows within the web application. To this end, I've had to grant "AmazonS3FullAccess" policy...

Identifying duplicate requests fired from back end


java,cloud
I am facing a use case where I need to track down duplicate requests, which are fired through REST API calls from back end. Each request writes into the database, and hence the duplicate requests need not be processed again. The duplicate requests may come in different threads under the...

Alternate to run window service in Azure cloud


azure,windows-services,cloud,azure-webjobs
We currently have a window service which send some notification emails to users after doing some processing on database(SQL database). Runs once in day. We want to move this on azure cloud. One alternate is to put it on Azure VM as is. but I am finding some other best...

What is Horizontal scaling in cloud ? What is difference between horizontal and vertical scaling?


cloud
What is Horizontal scaling in cloud ? What is difference between horizontal and vertical scaling ?

how to run a static site on bitnami and AWS?


amazon-web-services,website,cloud,hosting,bitnami
I am quite a noob when it comes to cloud based apps, this is a completely new context for me. I currently got the github education pack, part of it was an account on bitnami. I was wondering if it's possible to host a static html site on bitnami, I...

ssl error record too long using UI CloudStack


apache,ssl,cloud
I have just finished automatic installation of CloudStack. Now I want to connect to the user interface with Firefox on a remote host. So I enter https://192.168.xxx.xxx:8080/client and I get the error ssl_error_rx_record_too_long How can I solve this? I can only use cli to interact with the CloudStack Server....

Android application backend


android,architecture,cloud,backend,pull
I want to make an android application which will display an external message (For example: some quotes, proverbs etc) daily. The message should be retrieved from some place other than the client device and I would like to configure the messages from back end These messages should also change everyday....

Reduce Storage, By Juggling Packets in Network?


networking,tcp,cloud,server,transfer
I want to preface this by saying, I have a feeling that this idea will not work the way I'm imagining, but I'm sure why. Its likely I'm making some sort of false assumption about the way the internet works. Lets say server A has a file of size 1024...

viewing google app engine Python logging messages in CodeEnvy


python,google-app-engine,logging,cloud
I'm trying to move my GAE development to the cloud. So far Codeenvy has the richest toolset however I'm struggling with one small issue. when I use the python logging library I don't know where to view these messages! def post(self): self.response.write('Processing form data...') feedback = self.request.get('content') logging.info(feedback) I assumed...

AWS Instance Type For 3,000+/Second Outgoing HTTP Requests?


amazon-web-services,amazon-ec2,cloud,server,amazon
I'm currently scaling up an application on AWS, we send thousands of outgoing HTTP requests per second to 3rd party API's and services. Are there any EC2 instances optimized for this type of work?

How scale up/out mechanism works in OpenStack and Cloudfoundry integration?


cloud,openstack,cloudfoundry,bosh
I just started investigating OpenStack & Cloudfoundry recently, and I just wonder how scale up/out mechanism works in OpenStack & Cloudfoundry integration. As far as I understand, if we need to scale-up a web app, Cloudfoundry will try to create a new container to run new web app. If it...

Digi Device API reading Datastream / DIO / AD


xml,cloud,xbee
I have XBee Gateway ZB, Wifi and I'm experimenting with the Digi Device API. I already tried the Heroku App xbeegateway.herokuapp.com and it works really good. So I wanted to access online the Datastream. Using Google Spreadsheet or something like this. So reading the documentation from digi. I could acces...

Generate Cloud Endpoints file in IntelliJ IDEA


intellij-idea,cloud,google-cloud-endpoints,endpoints
In Eclipse there's an easy way to generate Endpoints file from a Java class(right click on class -> google -> generate endpoints file), but I cannot find this feature in IntelliJ. How should I do this? Thanks...

Creating a scalable database for android app | cloud hosted


android,cloud,google-cloud-storage,cloud-hosting,android-database
I am working to launch an app which in future will store huge number of users and there profile information. But I Wanted to start small to pre-test my app idea , so what will be the options for hosting database which are cost effective initially and scalable in future...

How to get Tags of Azure ResourceManagementClient object


c#,azure,cloud
I' m trying to get tag list of the resource groups with ResourceManagementClient class. 'Microsoft.Azure.Management.Resources 2.14.1-preview' is added from Package Manager Console ResourceManagementClient resourceClient = new ResourceManagementClient(new Microsoft.Azure.CertificateCloudCredentials(SubscriptionId, cert)); var tags = resourceClient.Tags.List(); I get this error; AuthenticationFailed: Authentication failed. The 'Authorization' header is not present or provided in an...

Cloud vs NoSQL for scalable web applications [closed]


azure,cassandra,nosql,cloud,scalability
I want to have some basic understanding of the following. In order to build a scalable web application, what are the options they have ? What is the difference among the following 1) simply using noSQL databases(like Cassandra) for scalability 2) Using cloud services (like Azure, Openstack) for scalability 3)...

Storing data needed to be retrieved in my mobile app


android,database,data,cloud,server
I have seen many examples retrieving data from websites to be used as contents of applications. Now I am developing my own app, I have my own contents to be delivered to my users, where am I supposed to store my contents so it can be retrieved from my app?...

Are private clouds scalable during demand variations?


cloud,scalability
Whenever someone talks about advantages of cloud computing they say flexibility and scalability. When using a public cloud, when I'm not using the power, someone else is, but what about a private cloud? Lets say a company uses a private cloud. If the company is growing, adding more hypervisors or...

Automatic copying of some value whenever it's changed in cloud code [ parse.com ]


parse.com,copy,cloud,pfobject
How to write in cloud code ( parse.com ) a short program that automaticaly copies value of a field of one PFObject to certain field of other PFObject (of different class than the original one) whenever the original field is being changed? For example I have some user's name and...

How to conditionally check the state of an openstack instance


cloud,state,conditional-statements,ansible,openstack
I am trying to conditionally check the state of an openstack cloud instance in my playbook. The playbook itself takes the name of a cloud instance as a parameter and then deletes it by setting the state to absent using nova compute. What I want to do is check if...

How does CoreOS load balancing work out there in the wild on a cloud service?


cloud,cluster-computing,load-balancing,coreos
Say I have a CoreOS cluster deployed on some cloud service somewhere. Now I have, say, 4 machines running a node.js app which follows all the 12-factor tenets and one machine with Couchbase. How does load balancing work in this scenario? Wouldn't ONE ip eventually run out of juice as...

spring cloud config client not loading configuration from config server


spring,cloud,config
I am following this link: http://cloud.spring.io/spring-cloud-config/spring-cloud-config.html#_client_side_usage I tested this again and again and not seeing Spring cloud client is loading configuration from cloud server, please help to see where is the error: POM: <dependencies> <dependency> <groupId>org.springframework.cloud</groupId> <artifactId>spring-cloud-starter</artifactId> </dependency> <dependency> <groupId>org.springframework.boot</groupId>...