Forget about this way : even if this having millions of children
entities for one ancestor is theoretically feasible, you'll hit a
write performance issue when you generate those entities : only 1
write / second in one given entity group (ancestor).
On 17 fév, 03:16, hendrix.jason
No full text search in this release??
--
You received this message because you are subscribed to the Google Groups
Google App Engine for Java group.
To post to this group, send email to google-appengine-java@googlegroups.com.
To unsubscribe from this group, send email to
SERIOUSLY???
(why don't you give any visibility on this key feature, like you did
with FTS?)
On Sep 28, 10:52 pm, Ikai Lan (Google) ika...@google.com wrote:
You currently can't, but we plan on rolling out a feature that will do this
in the next few releases. It's currently in trusted tester at
Speaking about memcache, could someone give a clear confirmation
whether I should use import net.sf.jsr107cache.Cache or
javax.cache.Cache.
Documentation is still misguiding about this point.
Thanks.
--
You received this message because you are subscribed to the Google Groups
Google App Engine
you MUST have a look at
http://ikaisays.com/2010/07/09/using-the-java-mapper-framework-for-app-engine/
There's a special section at the end of the post delete all entities
of a given kind.
You can delete 35M entities in a few minutes using mapreduce.
--
You received this message because you are
Do not use the method Text.toString(), use Text.getValue() instead.
--
You received this message because you are subscribed to the Google Groups
Google App Engine for Java group.
To post to this group, send email to google-appengine-java@googlegroups.com.
To unsubscribe from this group, send
Check out
http://ikaisays.com/2010/08/11/using-the-app-engine-mapper-for-bulk-data-import/
--
You received this message because you are subscribed to the Google Groups
Google App Engine for Java group.
To post to this group, send email to google-appengine-java@googlegroups.com.
To unsubscribe
Yes, I have noticed the same behaviour.
My workaround: once a index has been automatically generated, I copy
its xml configuration from datastore-indexes-auto.xml to datastore-
indexes.xml.
Thus I consider datastore-indexes-auto.xml as automatic
propositions.
On Jun 30, 12:14 pm, Ian Marshall
Check ikai lan's blog about the bulk load mapper.
Using a mapreduce job is the solution you are looking for.
On Jun 22, 4:58 am, finder-auto_admin gontran.mag...@gmail.com
wrote:
Hello all,
I just tried to import data in my datastore from a big csv file and like
others, I got the Deadline
Data schema change is quite easy if you use a MapReduce job.
See
http://ikaisays.com/2010/07/09/using-the-java-mapper-framework-for-app-engine/
You can still use your JDO instructions in a mapper, even if the mapper
performance is not at its best if not using the low-level API.
--
You
I have a mapper job, that takes several hours to complete.
I switched from the latest version to an older one while it was running.
It seems all new tasks after I switched have been completed using the old
version mapper.
For my knowledge: is that what I should expect ?
--
You received this
All mappers return this log message.
Please note it's an INFO message, so you shouldn't worry about it.
On Apr 20, 7:49 am, Santosh kumar kopp@gmail.com wrote:
Hi,
I have a mapper which is running fine without errors,
but finally it displaying Returning NOBODY because of SkipAdminCheck...
We are testing the mass creation of a very large number of entities in the
datastore (several billions).
We use csv files (approx. 100 Mb each), uploaded into the blobstore, and run
mapper jobs on them.
Our goal : minimize the overall execution time (whatever the cost).
There seems to be an
I guess you are using [eclipse + sts + google plugins].
This shit happens to me all the time.
You JUST need to edit your persisting class, add a space somewhere,
and have datanucleus rebuild your class persistence stuff.
I have 20+ persisting classes, and I sometimes need to edit those 20+
files
Add a @Basic annotation to your SetString property.
--
You received this message because you are subscribed to the Google Groups
Google App Engine for Java group.
To post to this group, send email to google-appengine-java@googlegroups.com.
To unsubscribe from this group, send email to
If your app is gwt-based, you can reduce the size of your resources by
reducing the number of permutations.
Gwt compiles one specific final resource package for each permutation (e.g:
5 browsers x 3 locales 15 permutations).
This might lead to very heavy resources. See
either
Facing the same problem (error 400).
Maybe I did the same super stupid error as you did.
What did you do ?
--
You received this message because you are subscribed to the Google Groups
Google App Engine for Java group.
To post to this group, send email to google-appengine-java@googlegroups.com.
Anyone facing deployment issues today ?
After several attempts, I only got errors 400 request is invalid for
unspecified reasons.
Any clue ?
-- error log: -
com.google.appengine.tools.admin.AdminException: Unable to update app: Error
posting to URL:
I handle a class MyClass that holds a list property myListProperty.
I use the low-level API to query over this class, with a dynamic number of
filters over this very single field.
Those filters mainly use different kind of operators (inequality filters and
in filters).
Sample code:
Query q = new
Say you manage an entity kind with a com.google.appengine.api.datastore.Key
key,
and you manage those keys with explicit values like key =
KeyFactory.createKey(MyClass.class.getSimpleName(), AAA).
Then, does the string-encoded form of the key have the same lexicographic
order than the explicit
Some time ago, relationships between entities of same kind were not
supported by the datastore.
This was annoying in particular when trying to movel tree structures
(@OneToMany relationship between MyClass and MyClass).
The datastore documentation was pretty clear about this.
I cannot find this
Have some of you succeeded in bootstrapping a project with Spring Roo with
use of ACTUAL parent/child relationships ?
I mean with real Parent(X)/Child(Y) keys, NOT with the use of Long as keys
in entitiesŠ
--
You received this message because you are subscribed to the Google Groups
Google App
Guys,
As you know, one of the most powerful features regarding data modelling in
GAE is the ListProperty.
(i.e. the ability to manage a ListString property and to manage indexes
and queries over those GAE-specific fields)
Spring Roo and MyEclipse propose interesting stuff to scaffold CRUD
Has any of you succeeded in coding a servlet that uploads a file to the
blobstore WITHOUT passing through a post jsp form ?
(apologies, this might have been discussed a zillion time already in this
group)
Would be VERY helpful to me.
Thanks in advance,
cyrille
--
You received this message
My problem:
1. I execute a massive delete over a large number of entities (30 million),
using a mapreduce-based job similar to Ikai's one (*)
2. Then both the datastore viewer and the datastore statistics in the
dashboard become unavailable: I get this famous the server encountered an
error
, Cyrille Vincey crll...@gmail.com wrote:
It works, and the performance is breathtaking :
8.6 million entities (4.3 lines x 2 entities per line) created in 1.5h, using
100 shardsŠ
Compared to my previous non-blob-based mapper job, CPU cost remains a little
high (190 CPU hours), but I can't
Check your war WEB-INF datastore-indexes.xml
(NOT the war WEB-INF appengine-generated datastore-indexes-auto.xml)
You might read: datastore-indexes autoGenerate=false
Try to replace with : datastore-indexes autoGenerate=true
On 19/11/10 01:39, Jerry jerry.morri...@gmail.com wrote:
Great
://googleappengine.blogspot.com/
Reddit: http://www.reddit.com/r/appengine
Twitter: http://twitter.com/app_engine
On Thu, Nov 4, 2010 at 2:36 AM, Cyrille Vincey crll...@gmail.com wrote:
Not a lot of interesting stuff to say :
1. My code is quite as simple as your sample code: the only real difference is
that I
problem b4.
traced and found caused by datastore-indexes.xml existed b4 datastore
is created.
remove it then okay.
On Oct 21, 5:56 pm, Cyrille Vincey crll...@gmail.com wrote:
Same issue for the past 3 days.
Only occuring on the dev server.
I have tried for hours to solve it. No clue
You should have a look on the supported types in the datastore :
http://code.google.com/intl/fr-FR/appengine/docs/java/datastore/dataclasses
.html#Core_Value_Types
In your case, try the following:
entityOfTypePeople.setProperty(name, people.getName());
entityOfTypePeople.setProperty(country,
Has some of you already experienced permanent unavailability of the admin
UI datastore viewer ?
It's been 2 days I cannot access my data through the UI now...
I have no quota limitation, nor activity load, and offline jobs execution
(mapreduce mainly) is ok.
Any clue ?
--
You received this
, Nov 2, 2010 at 9:42 AM, Cyrille Vincey crll...@gmail.com wrote:
I've been testing Ikai's bulkload mapper (see url below) with a pretty big csv
file (200 Mb).
It works great, and I encourage most of you to consider implementing this for
entity uploads.
Yet, I do face one last issue
Both following syntaxes are ok for JDO :
Key key1 = KeyFactory.createKey(YourClass.class.getSimpleName(), 12345L);
//using Long
Key key2 = KeyFactory.createKey(YourClass.class.getSimpleName(),
yourtextid); //using String
It's up to you to define how you want your entities to be recorded :
1.
I've been testing Ikai's bulkload mapper (see url below) with a pretty big
csv file (200 Mb).
It works great, and I encourage most of you to consider implementing this
for entity uploads.
Yet, I do face one last issue with an unexpected quota : blobstore bytes
read.
This quota cannot be tuned via
I have seen the same error from times to times.
If you're on eclipse, this error may disappear if you clean your project
prior to deploying it.
Eclipse Project Clean...
On 01/11/10 14:15, gholler georgehol...@gmail.com wrote:
In the last couple of days we've been seeing
I am trying to figure out how to put 2 parent/child entities into the
mutationPool, inside a MapReduce job.
Here is my issue : in my understanding, as the mutationPool is asynchronous
, I cannot expect to get the parent entity key back from the
mutationPool.put() method.
Or can I ?
According to
You need to edit (or to create) a datastore-indexes.xml file in the
WEB-INF directory.
This file stores the index definition for your application.
Personal advice : do not rely on the automatic index definition that you
can see in the datastore-indexes-auto.xml (dir
WEB-INF/appengine-generated/)
/appengine/api/
datastore/KeyRange.html
--
Ikai
On Mon, Nov 1, 2010 at 8:11 AM, Cyrille Vincey crll...@gmail.com wrote:
I am trying to figure out how to put 2 parent/child entities into the
mutationPool, inside a MapReduce job.
Here is my issue : in my understanding, as the mutationPool
Can you please send the link to the video you refer to ?
From: Ben Woodhead benwoodhead1...@gmail.com
Reply-To: google-appengine-java@googlegroups.com
Date: Sat, 30 Oct 2010 22:56:12 -0700 (PDT)
To: google-appengine-java@googlegroups.com
Subject: [appengine-java] Hierarchical Search
Hello
You should use the method Text.getValue()
From: Michael Boswell mbo...@gmail.com
Reply-To: google-appengine-java@googlegroups.com
Date: Wed, 27 Oct 2010 17:38:48 -0700 (PDT)
To: google-appengine-java@googlegroups.com
Subject: [appengine-java] Text enclosed with Text: ~~~
I have a
Abort button doesn't work indeed.
When I want to abort a mapreduce job, I directly mapreduce-related entities
in the datastore viewer : MapReduceStat and ShardDontKnowWhat.
From: aswath satrasala aswath.satras...@gmail.com
Reply-To: google-appengine-java@googlegroups.com
Date: Thu, 28 Oct
Š I directly DELETE Š
(makes more sense with all the words)
From: Cyrille Vincey crll...@gmail.com
Date: Thu, 28 Oct 2010 09:56:51 +0200
To: google-appengine-java@googlegroups.com
Subject: Re: [appengine-java] mapreduce job is not aborted
Abort button doesn't work indeed.
When I want
:
thanks Cyrille, no jobs are now running.
-Aswath
On Thu, Oct 28, 2010 at 1:28 PM, Cyrille Vincey crll...@gmail.com wrote:
Š I directly DELETE Š
(makes more sense with all the words)
From: Cyrille Vincey crll...@gmail.com
Date: Thu, 28 Oct 2010 09:56:51 +0200
To: google-appengine-java
Have you created a descending index on the key of the entity group you try
to map ?
(required for mapreduce jobs)
From: suersh babu sureshgbab...@gmail.com
Reply-To: google-appengine-java@googlegroups.com
Date: Fri, 22 Oct 2010 14:52:17 +0530
To: google-appengine-java@googlegroups.com,
From my experience : I do NOT expect a better write performance than 1
transaction/second when creating entities inside one given entity group
(with 1 entity created in each transaction).
In your case : if dataset creation is an offline process, you can rely on
entity groups and parent/child data
Same issue for the past 3 days.
Only occuring on the dev server.
I have tried for hours to solve it. No clue...
Fortunately, no impact on the production environment.
On 21/10/10 11:50, Ian Marshall ianmarshall...@gmail.com wrote:
Hello All,
I am running my web application on the GAE/J 1.3.8
You need to change the GAE SDK version manually.
On my mac : Eclipse Preferences Google App Engine
On 19/10/10 08:03, Peter Liu tinyee...@gmail.com wrote:
Ok. I installed a new Eclipse (Helios), install the Google plugin with
only 1.3.8, created a new project, deploy to production, and still,
Am I the only one who cannot download the eclipse 1.3.8 update ?
On 15/10/10 14:51, Guillaume Laforge glafo...@gmail.com wrote:
Excellent, thank you!
The instances view is really nice and interesting!
I just wanted to also mention that while upgrading one of my apps, one
controller wasn't
Yes you do.
From: Vik vik@gmail.com
Reply-To: google-appengine-java@googlegroups.com
Date: Wed, 13 Oct 2010 18:47:33 +0530
To: Google App Engine for Java google-appengine-java@googlegroups.com
Subject: [appengine-java] Fwd: entity update question
Hie
I do for create like
try{
My workaround (I'm doing the testing so far) :
- create a extra property that merges the content of the N properties you
wish to filter on
- query on that single extrat property with inequality filters
That is what geohash does when merging latitude AND longitude into one
single property :
Remove the line pm.makeTransientAll((Collection)results); and it should
work fine.
And no need for the line query.closeAll();) as well.
On 11/10/10 12:14, Puneet puneet.nah...@gmail.com wrote:
In the below method, the makeTransientAll method is not working. I am
not able to show the contents of
Same exception happened to me once.
I was by error managing 2 pm instances, and trying to get an object with pm1
and to update it with pm2.
Envoyé de mon iPad
Le 3 oct. 2010 à 16:43, lisandrodc lisandr...@gmail.com a écrit :
Hi ! I have a problem when persist a class.
The exception is:
a écrit :
Cryille,
Using debug mode, I can see that the group_keys array is being
populated correctly.
The error is appearing on the last line:
ListGroup groups = (ListGroup) q.execute(group_keys);
Thanks,
Jason
On Sep 30, 3:41 am, Cyrille Vincey crll...@gmail.com wrote:
Try
The GAE Eclipse plugin is supposed to create all required indexes in the
config files when running the app in development mode.
Those indexes are configured in the datastore-indexes-auto.xml file (dir
: WEB-INF appengine-generated)
Sometimes it happens some indexes are missing.
Then create or
On 23 sep, 05:25, Cyrille Vincey crll...@gmail.com wrote:
There is no primary key in your child class.
Add one.
On 23/09/10 04:40, lisandrodc lisandr...@gmail.com wrote:
Hi ! I have a problem when persist a chid class.
The parent class:
@PersistenceCapable
@Inheritance(strategy
You're facing the exploding indexes problem.
You should never put more than 1 list properties in one composite index.
This problem is described in the GAE doc.
http://code.google.com/intl/fr-FR/appengine/docs/python/datastore/queriesan
dindexes.html#Big_Entities_and_Exploding_Indexes
On 24/09/10
the solution is creating a index like this:
keyWordsList ▲ , keyWordsList ▲ , keyWordsList ▲
Isn't this really the build-in index ?
On Sep 24, 5:16 pm, Cyrille Vincey crll...@gmail.com wrote:
You're facing the exploding indexes problem.
You should never put more than 1 list properties in one composite
There is no primary key in your child class.
Add one.
On 23/09/10 04:40, lisandrodc lisandr...@gmail.com wrote:
Hi ! I have a problem when persist a chid class.
The parent class:
@PersistenceCapable
@Inheritance(strategy = InheritanceStrategy.SUBCLASS_TABLE)
public abstract class Fecha
What drives the number of active shards in a mapreduce job ?
In my case, mapreduce jobs execution usually work fine, but only ONE shard
actually processes entities, the 3 others don't.
Any clue ?
On 14/09/10 00:06, Benjamin bsaut...@gmail.com wrote:
OK thanks Ikai,
I was trying to avoid
Be aware that inheritance is not supported by GAE yet.
The problem might come from this issue.
See :
http://code.google.com/intl/fr-FR/appengine/docs/java/datastore/dataclasses.
html
cyrille
On 19/09/10 18:55, lisandrodc lisandr...@gmail.com wrote:
Thanks dushyant , but the exception is of an
Dear All,
I am facing a strange issue using the KeyFactory.createKey() method : keys
generated by this method are stored as unowned relationships, but are
actually not recognized by the datastore viewer (the key-URL does not work).
Hopefully you could help me on this.
A few words about my source
Stepmas, please keep us informed with your tests on that particular point,
as we are currently changing our data model to match Brett's recommandation
about list properties in child object.
On 09/09/10 11:58, Frederik Pfisterer pfiste...@gmail.com wrote:
I experienced this with lists of complex
Massive upload / download : have a look on the appengine bulkloader.
If no need for massive download, just... develop a java servlet.
On 07/09/10 19:11, dciesli...@yahoo.com dciesli...@yahoo.com wrote:
Does anyone has or know where to find detail example how to use
uploading downloading data
in a valid
file
Regards
Lisandro
On 7 sep, 09:48, Cyrille Vincey crll...@gmail.com wrote:
I have read somewhere in the appengine doc that class inheritance is not
really supported by JDO yet...
On 07/09/10 00:39, lisandrodc lisandr...@gmail.com wrote:
Hi all,
I've used hibernate
I have read somewhere in the appengine doc that class inheritance is not
really supported by JDO yet...
On 07/09/10 00:39, lisandrodc lisandr...@gmail.com wrote:
Hi all,
I've used hibernate for a while, and I'm having a bit of trouble
switching to JDO. I have several entities that all
65 matches
Mail list logo
