[gora] branch master updated (14e75d76 -> b4bd0276)
This is an automated email from the ASF dual-hosted git repository. djkevincr pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/gora.git from 14e75d76 Upgrade spark to 2.4.8 (#272) add b4bd0276 GORA-694 Upgrade Aerospike to the latest driver (#256) No new revisions were added by this update. Summary of changes: .../aerospike/store/AerospikeMappingBuilder.java| 21 - pom.xml | 2 +- 2 files changed, 1 insertion(+), 22 deletions(-)
[gora-site] branch GORA-703 created (now 1093967)
This is an automated email from the ASF dual-hosted git repository. djkevincr pushed a change to branch GORA-703 in repository https://gitbox.apache.org/repos/asf/gora-site.git at 1093967 GORA-703 move members to emeritus This branch includes the following new commits: new 1093967 GORA-703 move members to emeritus The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference.
[gora-site] 01/01: GORA-703 move members to emeritus
This is an automated email from the ASF dual-hosted git repository. djkevincr pushed a commit to branch GORA-703 in repository https://gitbox.apache.org/repos/asf/gora-site.git commit 109396705e9fe485a7f7edcec0fc9f74f3bb0316 Author: djkevincr AuthorDate: Sun Mar 12 18:52:04 2023 +0100 GORA-703 move members to emeritus --- content/credits.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/content/credits.md b/content/credits.md index 8ace18e..bd73927 100644 --- a/content/credits.md +++ b/content/credits.md @@ -19,13 +19,11 @@ Gora active committers include (ordered by username) * [Chris A. Mattmann](http://sunset.usc.edu/~mattmann/) (mattmann) - NASA JPL **CPCH** * Roland von Herget (rherget) - ? **CP** * Renato Marroquin (rmarroquin) - Universidad Catolica San Pablo **CP** -* Sertan Alkan (sertan) - Konneka **CP** * Dave Woollard (woollard) - NASA JPL **CP** * [Alparslan Avcı](http://tr.linkedin.com/pub/alparslan-avci/15/b19/b42/) (alparslanavci) - AGMLab **CP** * [Apostolos Giannakidis](http://uk.linkedin.com/in/giannakidisapostolos) (apgiannakidis) - Oracle **CP** * [Damien Raude-Morvan](https://www.linkedin.com/in/damienraudemorvan) (drazzib) - [Dictanova](http://www.dictanova.com) **CP** * [Pierre Sutra](https://sites.google.com/site/0track/) (otrack) - [Telecom SudParis](http://www.telecom-sudparis.eu/) **CP** -* [Madhawa Gunasekara](http://www.linkedin.com/in/mgunasekara) (madhawa) - Independent **CP** * [Talat Uyarer](https://tr.linkedin.com/in/talatuyarer) (talat) - **CP** Gora members can be contacted by appending @apache.org to their usernames. @@ -48,6 +46,8 @@ Gora members can be contacted by appending @apache.org to their usernames. * [Ferdy Galema](http://www.linkedin.com/pub/ferdy-galema/4/5ba/b44) (ferdy / ferdy.g (JIRA)) - Kalooga **CP** * Dogacan Guney (dogacan) - Google **CP** * Julien Nioche (jnioche) - DigitalPebble **CP** +* Sertan Alkan (sertan) - Konneka **CP** +* [Madhawa Gunasekara](http://www.linkedin.com/in/mgunasekara) (madhawa) - Independent **CP** ## Contributors
[gora] branch master updated (073d6dfa -> 14e75d76)
This is an automated email from the ASF dual-hosted git repository. djkevincr pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/gora.git from 073d6dfa GORA-693 Improve gora-jet test cases (#255) add 14e75d76 Upgrade spark to 2.4.8 (#272) No new revisions were added by this update. Summary of changes: pom.xml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
[gora] branch master updated: GORA-693 Improve gora-jet test cases (#255)
This is an automated email from the ASF dual-hosted git repository. djkevincr pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/gora.git The following commit(s) were added to refs/heads/master by this push: new 073d6dfa GORA-693 Improve gora-jet test cases (#255) 073d6dfa is described below commit 073d6dfa3ae699bc8856611adb7ef531effbe8fc Author: trisha-melani <93732746+trisha-mel...@users.noreply.github.com> AuthorDate: Sun Mar 12 22:37:56 2023 +0530 GORA-693 Improve gora-jet test cases (#255) * GORA-693 Improve gora-jet test cases * Remove unnessary system out --- .../src/test/java/org/apache/gora/jet/JetTest.java | 43 +++--- 1 file changed, 37 insertions(+), 6 deletions(-) diff --git a/gora-jet/src/test/java/org/apache/gora/jet/JetTest.java b/gora-jet/src/test/java/org/apache/gora/jet/JetTest.java index 1f813db0..95544b32 100644 --- a/gora-jet/src/test/java/org/apache/gora/jet/JetTest.java +++ b/gora-jet/src/test/java/org/apache/gora/jet/JetTest.java @@ -34,6 +34,7 @@ import org.apache.hadoop.hbase.HBaseTestingUtility; import org.junit.BeforeClass; import org.junit.Test; +import java.util.Map; import java.util.regex.Pattern; import static com.hazelcast.jet.Traversers.traverseArray; @@ -69,9 +70,9 @@ public class JetTest { resultPageView1.setUrl("How are you"); ResultPageView resultPageView2 = new ResultPageView(); -resultPageView1.setIp("88.240.129.183"); -resultPageView1.setTimestamp(124L); -resultPageView1.setUrl("This is the jet engine"); +resultPageView2.setIp("88.240.129.183"); +resultPageView2.setTimestamp(124L); +resultPageView2.setUrl("This is the jet engine"); dataStoreOut.put(1L,resultPageView); dataStoreOut.put(2L,resultPageView1); @@ -121,10 +122,8 @@ public class JetTest { String ip = ""; while (result.next()) { noOfOutputRecords++; - ip = result.get().getIp().toString(); - assertEquals("88.240.129.183", ip); } -assertEquals(2, noOfOutputRecords); +assertEquals(3, noOfOutputRecords); } @Test @@ -147,4 +146,36 @@ public class JetTest { IMap counts = jet.getMap("COUNTS"); assertEquals(3L, (long)counts.get("the")); } + + @Test + public void jetWordCountExtended() throws GoraException { +dataStoreOut = DataStoreFactory.getDataStore(Long.class, ResultPageView.class, utility.getConfiguration()); + +Query query = dataStoreOut.newQuery(); +JetEngine jetEngine = new JetEngine<>(); + +Pattern delimiter = Pattern.compile("\\W+"); +Pipeline p = Pipeline.create(); +p.drawFrom(jetEngine.createDataSource(dataStoreOut, query)) +.flatMap(e -> traverseArray(delimiter.split(e.getValue().getUrl().toString( +.filter(word -> !word.isEmpty()) +.groupingKey(wholeItem()) +.aggregate(counting()) +.drainTo(Sinks.map("COUNTS")); +JetInstance jet = Jet.newJetInstance();; +jet.newJob(p).join(); +IMap counts = jet.getMap("COUNTS"); + +assertEquals(3L, (long)counts.get("the")); +assertEquals(1L, (long)counts.get("This")); +assertEquals(1L, (long)counts.get("is")); +assertEquals(1L, (long)counts.get("jet")); +assertEquals(1L, (long)counts.get("engine")); +assertEquals(1L, (long)counts.get("How")); +assertEquals(1L, (long)counts.get("are")); +assertEquals(1L, (long)counts.get("you")); +assertEquals(1L, (long)counts.get("I")); +assertEquals(1L, (long)counts.get("am")); +assertEquals(1L, (long)counts.get("one")); + } }
[gora] branch master updated: GORA-699 fix redis tests (#281)
This is an automated email from the ASF dual-hosted git repository. djkevincr pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/gora.git The following commit(s) were added to refs/heads/master by this push: new c8e940d5 GORA-699 fix redis tests (#281) c8e940d5 is described below commit c8e940d537b4d429237b489a10d3ddcc78f5dc4e Author: Kevin Ratnasekera AuthorDate: Sun Mar 12 14:06:05 2023 +0100 GORA-699 fix redis tests (#281) --- gora-redis/src/test/java/org/apache/gora/redis/GoraRedisTestDriver.java | 2 +- pom.xml | 2 +- 2 files changed, 2 insertions(+), 2 deletions(-) diff --git a/gora-redis/src/test/java/org/apache/gora/redis/GoraRedisTestDriver.java b/gora-redis/src/test/java/org/apache/gora/redis/GoraRedisTestDriver.java index ac6610d7..0023a2c8 100755 --- a/gora-redis/src/test/java/org/apache/gora/redis/GoraRedisTestDriver.java +++ b/gora-redis/src/test/java/org/apache/gora/redis/GoraRedisTestDriver.java @@ -33,7 +33,7 @@ import java.time.Duration; */ public class GoraRedisTestDriver extends GoraTestDriver { - private static final String DOCKER_IMAGE = "grokzen/redis-cluster:latest"; + private static final String DOCKER_IMAGE = "grokzen/redis-cluster:6.0.0"; private final GenericContainer redisContainer; private final StorageMode storageMode; diff --git a/pom.xml b/pom.xml index 5712cf8f..88e11ece 100755 --- a/pom.xml +++ b/pom.xml @@ -843,7 +843,7 @@ 2.10.0 2.1.7 -3.11.0 +3.20.0 1.9.0