FAQ Database Discussion Community


Sync github repository with google cloud storage bucket

github,google-cloud-storage,google-cloud-platform
Is it possible to sync a GitHub repository with a google cloud storage bucket, so that I can edit the repository on GitHub and it automatically updates the bucket with the changes. I have already tried the google cloud platform source code tools, but I couldn't find any way to...

hadoop -appendToFile on Google Compute Engine cluster

hadoop,google-compute-engine,google-cloud-platform
I am having trouble performing the hadoop fs shell command, -appendToFile, on a GCE hadoop cluster. I have had success with other hadoop shell commands (e.g., -cat, -put, -mv) on the GCE cluster. In addition, I am able to use -appendToFile on a different hadoop cluster. However, I am unable...

go appengine: panic: proto: duplicate enum registered: appengine.LogServiceError_ErrorCode

google-app-engine,go,google-cloud-platform
I've recently updated my golang GAE SDK (goapp version is now go1.4.2 (appengine-1.9.21) darwin/amd64), and I'm getting this error now when trying to serve the app: orcaman$ goapp version go version go1.4.2 (appengine-1.9.21) darwin/amd64 Ors-MacBook-Pro:main orcaman$ goapp serve INFO 2015-05-23 12:45:38,666 devappserver2.py:745] Skipping SDK update check. INFO 2015-05-23 12:45:38,778 api_server.py:190]...

What is the difference between an Instance and an Instance group

google-compute-engine,google-cloud-platform
I was wondering what the difference between an instance and an instance group are. Can anyone explain the difference to me? Why can we use Autoscaler with an instance group and not with a instance...

How can I add/remove instances from GCE load balancers with Ansible?

google-compute-engine,ansible,google-cloud-platform
I see that there is a gce_lb Ansible module, but it is unclear to me whether or not I can actually use this to change the instances assigned to that LB or whether the module just creates and destroys LBs. In contrast, EC2 clearly has one module just for creating...

Google Logging API - What service name to use when writing entries from non-Google application?

google-api,google-cloud-platform,google-cloud-logging
I am trying to use Google Cloud Logging API to write log entries from a web application I'm developing (happens to be .net). To do this, I must use the logging.projects.logs.entries.write request. This request dictates that I provide a serviceName argument: { "entries": [ { "textPayload": "test", "metadata": { "serviceName":...

Can't connect to local gae endpoints from Genymotion emulator

java,android,google-app-engine,google-cloud-endpoints,google-cloud-platform
It's a simple helloworld project using endpoints generated from MyBean and MyEndpoint classes which come default with the Endpoints module. The emulator I use is Genymotion which I connect to through the /10.0.2.2 ip. When I access the endpoints server locally "localhost:8080" in my web browser it works just fine...

Migrating Service Account between BigQuery projects

google-bigquery,google-cloud-platform
I have 5 BigQuery projects namely Project1, Project2… Project5. I have a service account created in Project1. I am using this same service account in all the 5 projects for programatic insertion of rows. Now I plan to delete Project1 for some reasons. My question is whether the service account...

Does Google Container Registry undergo issues?

docker,google-cloud-platform,google-container-engine,google-container-registry
I am facing an issue while using container optimized VMs. I launch an instance with following command: gcloud compute instances create "$instance_name" \ --tags "http-server" \ --image container-vm \ --scopes storage-rw,logging-write \ --metadata-from-file google-container-manifest="m2.yml" \ --zone "$my_zone" \ --machine-type "$my_machine_type" where m2.yml is: version: v1beta2 containers: - name: nginx image:...

Is there a service for direct connectivity to Google Cloud?

google-compute-engine,google-cloud-platform
Is there a service available on Google Cloud for the direct connectivity between on-premise and the Google Cloud networks?

Unable to start appengine application after updating it via Google Cloud SDK

python,windows,google-app-engine,google-cloud-platform,gcloud
Recently I have updated google appengine from 1.9.17 to 1.9.18 via Google Cloud SDK by using command gcloud components update in Windows 7 64 bit. After that I couldn't able to start any of the project in appengine launcher. Getting this error: Traceback (most recent call last): File "C:\Program Files\Google\Cloud...

Error Installation Google Cloud SDK

python,osx,python-2.7,google-app-engine,google-cloud-platform
While following the installation steps for "Mac OS X" Installation and Quick Start I used the below command:- curl https://sdk.cloud.google.com | bash and directory extract under /Users/xxxxx/google-cloud-sdk/ but I got this error:- Traceback (most recent call last): File "/Users/xxxxx/google-cloud-sdk/bin/bootstrapping/install.py", line 8, in <module> import bootstrapping File "/Users/xxxxx/google-cloud-sdk/bin/bootstrapping/bootstrapping.py", line 9, in...

Asynchronous requests from App Engine to Cloud Storage

google-app-engine,google-cloud-storage,google-cloud-platform
In my App Engine app I'm using Python Client for Google App Engine to read data from Cloud Storage. When I'm reading multiple files from Cloud Storage, is there an option to make this process asynchronous?...

Hive on Google Cloud wants permissions on /tmp, but no way to change permissions

hadoop,hive,google-compute-engine,chmod,google-cloud-platform
I'm trying to run Hive on a Google Cloud, where Hadoop was installed by click-to-deploy. Hive seems to instal just fine, but when I run hive I get the following erroneous output: Logging initialized using configuration in jar:file:/home/michael_w_sherman_gmail_com/apache-hive-0.14.0-bin/l ib/hive-common-0.14.0.jar!/hive-log4j.properties SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in...

Changing Permissions of Google Container Engine Cluster

node.js,google-cloud-storage,google-cloud-sql,google-cloud-platform,google-container-engine
I have been able to successfully create a Google Container Cluster in the developers console and have deployed my app to it. This all starts up fine, however I find that I can't connect to Cloud SQL, I get; "Error: Handshake inactivity timeout" After a bit of digging, I hadn't...

How to know if a machine is an Google Compute Engine instance

google-compute-engine,google-cloud-platform
Is there a way to know from a command line shell if I am currently on a Google Compute Engine machine or somewhere else (development machine)?

google compute engine tool gcloud is exceptionally slow

google-compute-engine,google-cloud-platform,att,gcloud
I tried downloading and using the gcloud bash tool to manage my accounts, however everything I do with the tool is exceptionally slow. It will take MINUTES to reply to a command that is typed. Is there perhaps a firewall I need to open up on my router or something...

how to implement a website with cloud storage?

html,google-app-engine,website,google-cloud-platform
I want to implement a website interface, where the website consist of multiple users and one admin , each user can upload/ download data to the website with some privileges to each user. the data should stored in a cloud such as google-cloud. i am planning to implement the website...

Google Container Engine (GKE): “Hello Wordpress” tutorial not working (ERR_CONNECTION_REFUSED)

google-cloud-platform,kubernetes,google-container-engine
I'm trying to setup example from Running Wordpress with a Single Pod. I've done Before You Begin section: $ gcloud config list [compute] zone = europe-west1-c [core] account = [email protected] disable_usage_reporting = False project = com-project-default I've done the steps from the tutorial: "Step 1: Create your cluster" logs here...

BigQuery bq command with asterisk (*) doesn't work in Compute Engine

google-bigquery,google-compute-engine,google-cloud-platform
I have a directory with a file named file1.txt And I run the command: bq query "SELECT * FROM [publicdata:samples.shakespeare] LIMIT 5" In my local machine it works fine but in Compute Engine I receive this error: Waiting on bqjob_r2aaecf624e10b8c5_0000014d0537316e_1 ... (0s) Current status: DONE BigQuery error in query operation:...

Is it possible to connect between AppEngine and Computer engine's virtual machine?

google-app-engine,google-compute-engine,google-cloud-platform
I want my AppEngine site to connect to one of my instances (Google Compute Engine ) in order to get some data from a local redis server. How can I do that? It seems there's no way to get a connection between AppEngine and Compute Engine within the same account/project......

Google Cloud Storage: How can I grant an installed application access to only one bucket?

authorization,google-cloud-storage,google-cloud-platform
I'm developing an application that manipulates data in Google Cloud Storage buckets owned by the user. I would like to set it up so the user can arrange to grant the application access to only one of his or her buckets, for the sake of compartmentalization of damage if the...

ERROR: (gcloud.preview) Invalid choice: 'docker'. Did you mean 'dm-v2'?

docker,google-cloud-platform,gcloud
Somehow I was able to push my docker image to Google Container Registry with command: $ gcloud preview docker push gcr.io/<my-project-xxx>/<my-image-yyy> I ran the commands yesterday and copied them to my notes, but today pasting them to terminal in the same order I get the error: ERROR: (gcloud.preview) Invalid choice:...

Google Cloud ssh timeout: how to increase session time?

ssh,google-cloud-platform
For connection from Linux I use: gcloud compute --project "xxx" ssh --zone "europe-west-b" "yyy" After ~10 minutes of innactivity my console freeze or I see error 255....

Cannot add extra scope when running Datastore Wordcount Example

google-cloud-platform,google-cloud-dataflow
I am attempting to run the DatastoreWordCountExample from the Dataflow SDK. The instructions indicate that I should run the following commands: $ export CLOUDSDK_EXTRA_SCOPES=https://www.googleapis.com/auth/datastore $ gcloud auth login However, when I do, I receive the following error: $ export CLOUDSDK_EXTRA_SCOPES=https://www.googleapis.com/auth/datastore $ gcloud auth login Traceback (most recent call last): File...

Google Cloud Bigtable Durability/Availability Guarantees

high-availability,google-cloud-platform,google-cloud-bigtable
I would like someone from Google to provide some guidelines on the durability and availability guarantees provided by the Cloud Bigtable service. Here is my understanding so far: The fact that the minimum cluster requires 3 nodes suggests that, at least within a zone, the data is highly durable and...

Getting A Better Understanding Of Streaming Inserts With BigQuery

google-bigquery,google-cloud-platform
I understand that there has been a material change relating to the BigQuery streaming API. As I received in a message from the Google cloud team on Thursday, May 14th: "In 2013, we launched Google BigQuery streaming API, making it easy to analyze large amounts of data quickly. This product...

Is there a limit to the number of namespaces I can use in Google Cloud Datastore?

google-app-engine,namespaces,google-cloud-platform,google-cloud-datastore
I'm guessing the answer is no because there is no limit specified in the documentation but I'm a bit confused because the namespace selection shows up as a dropdown in the Google Cloud console, implying that there shouldn't be more namespaces than can fit in a dropdown menu. Basically I...

Google .NET CloudCredential sample?

.net,google-cloud-platform,iaas
I am trying to figure out how to programmatically interact with Google IaaS using the .NET API, but I'm a bit lost. The sample code doesn't work with ComputeCredential at all, and the source doesn't really make it clear to me. I see a bug request asking to create a...

How to measure how many requests my plan of Google App Engine (web app) can handle per day? [closed]

java,jsp,google-app-engine,servlets,google-cloud-platform
I have developed and deployed a JSP/Servlet java web app on Google App Engine. The web app makes http requests to a third-party web site to retrieve data via REST services and show the data on the client side to the user who accesses my web app via "appspot". So...

Cannot use calculated offset in BigQuery's DATE_ADD function

google-bigquery,tableau,google-cloud-platform
I'm trying to create a custom query in Tableau to use on Google's BigQuery. The goal is to have an offset parameter in Tableau that changes the offsets used in a date based WHERE clause. In Tableau it would look like this: SELECT DATE_ADD(UTC_USEC_TO_MONTH(CURRENT_DATE()),<Parameters.Offset>-1,"MONTH") as month_index, COUNT(DISTINCT user_id, 1000000) as...

How do I add a startup script to an existing VM from the developer console?

google-compute-engine,google-cloud-platform
I have an existing, already configured VM on Google Cloud Platform. It was created without a startup script, but I'd like to add one now. How do I add it from the console.developers.google.com web interface? ...

How to add external NTFS drive to Google Cloud Engine app?

google-compute-engine,google-cloud-platform
Since using docker takes up a lot of space for images, I would like to attach an external hard drive to my 10GB instance Ubuntu VM. However, I've added a blank disk and attached it, but I end up with this message when I type "fdisk -l": Disk /dev/sdb doesn't...

Choosing the correct google cloud data storage strategy for images [closed]

google-app-engine,google-cloud-storage,google-cloud-sql,google-cloud-platform,google-cloud-datastore
I'm writing my first google cloud backend for an image sharing mobile app and I'm having difficulties understanding which data storage option to go for. The clients will be mobile apps and probably also a web frontend. From what I've read so far the AppEngine seems to be a nice...

Google Cloud and Bizspark licenses

windows-server-2012,google-cloud-platform,windows-server
My team has Bizspark account and we want to use free licenses for Windows Server 2012. Is it possible to set Windows Server 2012 license key manually somewhere in Google Cloud Service? And if we'll change it in OS, will Google anyway take our money? Thanks....

Starting and stopping instances on google compute engine

google-compute-engine,google-cloud-platform,jclouds
I want to start/resume and stop/suspend instances on google compute engine, but it gives "java.lang.UnsupportedOperationException".Is there any alternative way to perform these operations? public class Example { public static void main(String[] args) { String provider = "google-compute-engine"; String identity = "****@developer.gserviceaccount.com"; String credential = "path to private key"; String groupName...

Websocket port on google managed vm

google-app-engine,google-cloud-platform
I have tried to use managed vm to run an web socket server over port 3000 but i can only connect to it via the ip of the instance, and not by my own domain or "appspot" domain. When i access the app on port 80 i get the right...

How do you update a container in a container-vm after its image changed in Google Container Engine?

google-cloud-platform,google-container-engine,google-container-registry
I run a service in a container on a container-vm on Google Container Engine. I followed https://cloud.google.com/compute/docs/containers/container_vms#creating_containers_at_time_of_instance_creation with first creating the containers.yaml conf: version: v1beta2 containers: - name: example-image image: gcr.io/your_project_name/example-image And then creating the instance: gcloud compute instances create containervm-example \ --image container-vm \ --metadata-from-file google-container-manifest=containers.yaml \ --zone us-central1-a...

How to get auto generated id from Google Cloud DataStore

google-cloud-platform,google-cloud-datastore
The documentation here says that I can omit the numeric id of an entity and DataStore will assign one automatically. It however, does not say how to retrieve the auto generated id. How does one get it? Is it available in the response or do I have to make a...

Can Objectify library be used outside GAE?

google-app-engine,gae-datastore,google-cloud-platform
I want to use the Google Cloud Datastore. However, I am not using GAE. Can I still use the Objectify library? If so how? The documentation doesnt say anything about how to configure it to authenticate against Datastore....

Is it possible to load balance several services using the same HTTP load balancer in GCE?

load-balancing,google-compute-engine,google-cloud-platform
I have one website and one api server on different instances: Is it possible to serve both of them through the same HTTP load balancer? Is there a down side to doing this vs. 2 load balancers? I went over these: https://cloud.google.com/compute/docs/load-balancing/http/ https://cloud.google.com/compute/docs/load-balancing/http/cross-region-example ...

Can projects be transferred to another account

google-cloud-platform,google-cloud-dns
I have set up a series of zones in one project under cloud dns. I would like to transfer this project, with the zones, to another account. Any ideas about how to do this? Seems that projects, should be able to be transferred to another account within a Google apps...

Setting up freeswitch server on Google cloud compute

google-cloud-platform,freeswitch,telecommunication
I am trying setup freeswitch server on google cloud compute (ubuntu 14.04) although it work fine for me locally, I seem to get the following error when I start freeswitch server on google cloud compute.Can any one explain? 2015-06-11 05:40:32.001508 [ERR] sofia.c:2853 Error Creating SIP UA for profile: internal-ipv6 (sip:[email protected][::1]...

Does Google Compute Engine support HTTPS?

ssl,google-compute-engine,google-cloud-platform
I recently signed up for google compute engine and managed to get my web app setup etc. But Google says that adding SSL certificates is currently only available for Alpha users? https://cloud.google.com/compute/docs/load-balancing/http/ssl-certificates Does that mean GCE doesn't allow https or is there any other method, i can get https working?...

Android studio checkout from Version Control: Google Cloud

android-studio,version-control,gradle,google-cloud-platform
I uploaded an android studio project with VCS->Import Into Version Control->Upload Project to Google Cloud. The project is succesfully uploaded as I see it in the developer console. The promlem come when I try to Checkout it from my other pc. I select the Google Project Id and choose clone,...

Google HTTP load balancing enforce HTTPS

load-balancing,google-cloud-platform,gcloud
I have a HTTP and HTTPS load balancer on Goole Cloud. Is it possible to set it up to enforce (redirect) all connections to HTTPS?

How to mount volume for docker container via yaml manifest?

docker,google-cloud-platform,google-container-engine
I try to launch container-vm machine with following yaml: version: v1 kind: Pod spec: containers: - name: simple-echo image: gcr.io/google_containers/busybox command: ['nc', '-p', '8080', '-l', '-l', '-e', 'echo', 'hello world!'] imagePullPolicy: Always ports: - containerPort: 8080 hostPort: 8080 protocol: TCP volumeMounts: - name: string mountPath: /home readOnly: false restartPolicy: Always...

.\key.p12: open failed: ENOENT (No such file or directory)

java,android,google-cloud-storage,assets,google-cloud-platform
In my android application I'm accessing the Google cloud storage . I have generated the private key xxxxxxxkey.p12 .I have put my key file in assets folder . But while running the project it is not opening the key.p12 file . I have tried putting it outside the assets folder...

Retrieve project id from Google Compute Engine machine?

google-compute-engine,google-cloud-platform
I have two Google Cloud Platform projects (staging and production). I would like my application deployed on Google Compute Engine instance to automatically detected the project id. What is the way to do it?

Google Cloud Engine is there a way to determine project, instance, and zone of instance from command line?

google-cloud-platform
So I have a java application running on GCE and I want that application to be able to trigger snapshots of the disks that are on that instance. I was hoping this information could just be queried from the environment, however I haven't been able to find anything useful besides...

How to get invoice for the Google BigQuery project

google-bigquery,google-cloud-platform
I used Google Bigquery for a month and was billed $800. Since the amount was way high I disabled the billing immediately. However now I need the invoice for the amount charged. If I enable billing back, it gets associated to a new account. For contacting customer support I need...

Not able to revoke GAE app from Google account security permissions

google-app-engine,google-cloud-platform
My initial version uses the built-in GAE Users Service for application login/registration. However, I was not able to revoke the app's permissions from my Google account settings. https://security.google.com/settings/security/permissions Google has updated the dashboard. I think they missed a feature to allow users to revoke GAE apps permissions. Can someone help...

Auto boot up Compute engine

google-app-engine,google-compute-engine,google-cloud-platform
I want a compute engine to boot up at a particular time everyday, perform a task and then self shut down. I also have a Google App Engine continuously running, if that can be of any help!...

HealthCheck not working properly

google-compute-engine,google-cloud-platform
The HealthChecks in the Google Console are not working properly. Initially it worked properly. But now it is not working and always the instances in the backend service are shown unhealthy. Same instance if I hit the same health check manually working fine. Could someone please help me out on...

How to get public link for the uploaded file on google cloud storage in local dev server(Google App engine+JAVA)

java,google-app-engine,file-upload,google-cloud-platform
I am trying to upload the image files using gcs client library+java in local google app engine dev server. Images are uploaded successfully and i can see the entries created in local datastore under localhost:8888/_ah/admin/datastore How to get the public key for the uploaded images so that i can show...

Autoscaler and HTTPLoadBalancing with WordPress Application on Google Cloud

php,wordpress,google-compute-engine,google-cloud-platform
I tried to create a WordPress application with a 2 tier architecture on Google Compute Engine. Created an instance in which the WordPress Web and App servers are installed and configured it with the database credentials installed in another instance with the IP. Created an image out of this instance's...

Adding or removing nodes from an existing GCE hadoop/spark cluster with bdutil

google-cloud-platform,google-hadoop
I'm getting started with running a spark cluster on google compute engine backed by google cloud storage that is deployed with bdutil (on the GoogleCloudPlatform github), I am doing this as follows: ./bdutil -e bigquery_env.sh,datastore_env.sh,extensions/spark/spark_env.sh -b myhdfsbucket deploy I am expecting I might want to start with a cluster of...