This is an automated email from the ASF dual-hosted git repository. btellier pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/james-project.git.
from d0f4a63 MAILBOX-380 Bind CassandraEventsDeadLetters inside cassandra-guice new 4c234aa Fix typo in cassandra-rabbitmq Dockerfile conf new c9434d0 Rename instanciate to instantiate new e29ce6b JAMES-2910 TikaModule should fallback to JsoupTextExtractor when disabled new 927e500 JAMES-2910 Extract text from HTML upon ElasticSearch indexation new b91c2e1 JAMES-2910 Tika should delegate text extraction to Jsoup new fba29fa JAMES-2910 Jsoup should also handle all text mediaTypes new cb8f588 JAMES-2910 Jsoup is more efficient handling inputStream new 33ecf02 JAMES-2910 Use return early code style within JsoupTextExtractor new 96c21ae JAMES-2910 TikaTextExtractorTest shouldn't assert strongly line breaks new 06c1702 JAMES-2079 Indexing MimePart header is functionally not required new fe6cf8b JAMES-2079 Remove all non-queried IndexableMessage fields new a5974e6 JAMES-2078 Headers should indexed using nested objects new 9aa3ef8 JAMES-2080 Explicitly specify attachment mapping in ElasticSearch new d5038d3 JAMES-2080 Enable strict mapping for mailbox indexing new 4707ca9 JAMES-2078 headerSearchShouldIncludeMessageWhenDifferentTypesOnAnIndexedField is fixed new 68237a8 JAMES-2813 create a task for testing the serialization of additional information new bab0ed5 JAMES-2813 add tests to validate that the additional informations are updated new 6b473f8 JAMES-2813 add additional information in cassandra task execution details projection new 35aeb01 JAMES-2813 handle additional information in event sourcing task manager new 0a1a2bf JAMES-2813 add test to validate sequential execution in RabbitMQWorkqueue new df998a9 JAMES-2813 serialize error message and exception in Failed event new 0155645 JAMES-2813 handle additional information in event sourcing task manager new a50aa20 JAMES-2813 add tests to validate that the additional informations are updated new 214afec JAMES-2813 add javadoc to MemoryreferenceTask and MemoryReferenceWithCounterTask new e569ee9 JAMES-2813 rename InitialisationOperation to InitializationOperation new 56f3616 JAMES-2813 move DistributedTaskManagerModule to modules package new bbcd66a JAMES-2813 Make it possible to define an InitilizationOperation without creating a new type new 9731491 JAMES-2813 bind DistributedTaskManager first tasks for Webadmin serialization integration tests new b4dac47 JAMES-2813 Serialization binding for DeleteMailsFromMailQueueTask new dfe2cef JAMES-2813 Serialization binding for ReprocessingAllMailsTask new a0c8a2a JAMES-2813 Serialization binding for ReprocessingOneMailTask new 86e4891 JAMES-2813 Serialization binding for SingleMessageReindexingTask new 7022676 JAMES-2813 Serialization binding for MessageIdReIndexingTask new 51b1361 JAMES-2813 Serialization binding for UserReindexingTask new 6b82bbb JAMES-2813 Serialization binding for DeletedMessagesVaultRestoreTask new 52cab78 JAMES-2813 Serialization binding for DeletedMessagesVaultExportTask new 3e1e93a JAMES-2813 Serialization binding for ErrorRecoveryIndexationTask new 7ee5d5e JAMES-2813 Serialization binding for ClearMailQueueTask new 505ace5 JAMES-2813 Serialization binding for BlobStoreVaultGarbageCollectionTask new f2ceccc JAMES-2813 Serialization binding for ClearMailRepositoryTask new ca4de2c JAMES-2813 Serialization binding for MailboxMergingTask new f762816 JAMES-2813 Serialization binding for SingleMailboxReindexingTask new 6c5f0fc JAMES-2813 Serialization binding for DeletedMessagesVaultDeleteTask new 9557ef9 JAMES-2813 Split EventDeadLettersRedeliverTask into 3 tasks + serialization binding for theses tasks new ec2cea0 JAMES-2813 plug Schedulers leaks new 077bf85 JAMES-2886 Test route overriding behavior new dfb481e JAMES-2886 guice.extension.module should be optional new f5f2809 JAMES-2886 Swagger routes should be public new da8d74a JAMES-2886 Allow a user to define custom routes new a7ee2e5 JAMES-2886 Document extensions.routes in webadmin.properties new 33ef204 JAMES-2886 Clear documentation for all guice extensions new c82deaa JAMES-2813 Typo fixes for some javadoc of memory testing tasks The 52 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: .../MigrationTaskAdditionalInformationsDTO.java | 5 +- .../cassandra/migration/MigrationTaskDTO.java | 9 +- .../migration/MigrationTaskSerializationTest.java | 4 +- .../destination/conf/extensions.properties | 2 +- .../destination/conf/webadmin.properties | 7 +- .../destination/conf/extensions.properties | 2 +- .../destination/conf/webadmin.properties | 7 +- .../destination/conf/extensions.properties | 2 +- .../destination/conf/webadmin.properties | 7 +- .../destination/conf/extensions.properties | 2 +- .../cassandra/destination/conf/webadmin.properties | 7 +- .../destination/conf/extensions.properties | 2 +- .../jpa/destination/conf/extensions.properties | 2 +- .../memory/destination/conf/extensions.properties | 2 +- .../memory/destination/conf/webadmin.properties | 8 +- .../org/apache/james/mailbox/events/Group.java | 4 +- mailbox/cassandra/README.txt | 2 +- ...MailboxMergingTaskAdditionalInformationDTO.java | 2 +- .../cassandra/mail/task/MailboxMergingTaskDTO.java | 9 +- .../mail/task/MailboxMergingTaskTest.java | 2 +- .../elasticsearch/MailboxMappingFactory.java | 57 +++- .../ElasticSearchListeningMessageSearchIndex.java | 1 + .../elasticsearch/json/HeaderCollection.java | 106 ++++--- .../elasticsearch/json/IndexableMessage.java | 115 +++---- .../elasticsearch/json/JsonMessageConstants.java | 11 +- .../json/MessageToElasticSearchJson.java | 2 - .../james/mailbox/elasticsearch/json/MimePart.java | 28 +- .../elasticsearch/query/CriterionConverter.java | 13 +- .../ElasticSearchIntegrationTest.java | 2 - .../elasticsearch/json/HeaderCollectionTest.java | 15 +- .../elasticsearch/json/IndexableMessageTest.java | 34 +-- .../json/MessageToElasticSearchJsonTest.java | 52 ++-- .../src/test/resources/eml/htmlContent.txt | 26 ++ mailbox/memory/pom.xml | 5 - .../BlobStoreVaultGarbageCollectionTaskDTO.java | 7 +- ...aultGarbageCollectionTaskSerializationTest.java | 2 +- mailbox/store/pom.xml | 5 + .../store/extractor}/JsoupTextExtractor.java | 38 ++- .../store/extractor}/JsoupTextExtractorTest.java | 35 ++- .../src/test/resources/documents/html.txt | 0 ...ithNonIndexableAttachmentWithoutAttachment.json | 84 ++---- mailbox/store/src/test/resources/eml/htmlMail.json | 201 ++++++------- mailbox/store/src/test/resources/eml/mail.json | 256 ++++++++-------- .../store/src/test/resources/eml/nonTextual.json | 67 +++-- .../src/test/resources/eml/pgpSignedMail.json | 266 ++++++++--------- .../src/test/resources/eml/recursiveMail.json | 196 ++++-------- .../eml/recursiveMailWithoutAttachments.json | 115 +++---- mailbox/store/src/test/resources/eml/spamMail.json | 233 ++++++--------- mailbox/tika/pom.xml | 4 + .../james/mailbox/tika/TikaTextExtractor.java | 6 + .../james/mailbox/tika/TikaTextExtractorTest.java | 65 ++-- .../mailbox/tools/copier/MailboxCopierTest.java | 56 ++-- .../tools/indexer/ErrorRecoveryIndexationTask.java | 2 +- .../indexer/ErrorRecoveryIndexationTaskDTO.java | 5 +- .../mailbox/tools/indexer/FullReindexingTask.java | 24 +- .../tools/indexer/MessageIdReIndexingTask.java | 1 + ...geIdReindexingTaskAdditionalInformationDTO.java | 18 +- .../tools/indexer/MessageIdReindexingTaskDTO.java | 7 +- .../indexer/ReprocessingContextInformation.java | 10 +- .../indexer/ReprocessingContextInformationDTO.java | 33 ++- ...lboxReindexingTaskAdditionalInformationDTO.java | 25 +- .../indexer/SingleMailboxReindexingTaskDTO.java | 7 +- ...sageReindexingTaskAdditionalInformationDTO.java | 18 +- .../indexer/SingleMessageReindexingTaskDTO.java | 7 +- ...UserReindexingTaskAdditionalInformationDTO.java | 25 +- .../tools/indexer/UserReindexingTaskDTO.java | 7 +- ...rorRecoveryIndexationTaskSerializationTest.java | 11 +- .../FullReindexingTaskSerializationTest.java | 12 +- .../MessageIdReindexingTaskSerializationTest.java | 6 +- ...ngleMailboxReindexingTaskSerializationTest.java | 6 +- ...ngleMessageReindexingTaskSerializationTest.java | 6 +- .../UserReindexingTaskSerializationTest.java | 6 +- .../org/apache/james/CassandraJamesServerMain.java | 8 +- .../modules/data/CassandraDomainListModule.java | 8 +- .../data/CassandraRecipientRewriteTableModule.java | 6 +- .../data/CassandraUsersRepositoryModule.java | 8 +- .../mailbox/ElasticSearchMailboxModule.java | 6 +- .../mailbox/ElasticSearchQuotaSearcherModule.java | 6 +- .../james/modules/mailbox/TikaMailboxModule.java | 6 +- .../modules/metrics/CassandraMetricsModule.java | 6 +- .../CassandraMessageIdManagerInjectionTest.java | 6 +- .../james/data/LdapUsersRepositoryModule.java | 8 +- .../james/CassandraRabbitMQJamesServerMain.java | 10 +- .../DistributedTaskManagerModule.java | 28 +- .../james/modules/TaskSerializationModule.java | 330 +++++++++++++++++++++ .../modules/event/RabbitMQEventBusModule.java | 6 +- ...Operation.java => InitializationOperation.java} | 4 +- .../utils/InitilizationOperationBuilder.java} | 42 ++- .../server/ElasticSearchMetricReporterModule.java | 6 +- .../apache/james/modules/CommonServicesModule.java | 2 - .../james/modules/server/DNSServiceModule.java | 8 +- .../modules/server/DropWizardMetricsModule.java | 10 +- .../modules/server/GuiceMailRepositoryLoader.java | 2 +- .../modules/server/MailStoreRepositoryModule.java | 8 +- .../james/utils/GuiceProtocolHandlerLoader.java | 2 +- .../james/utils/InitializationOperations.java | 22 +- .../modules/InitializationOperationsTest.java | 14 +- .../apache/james/utils/ExtensionConfiguration.java | 5 +- .../org/apache/james/utils/GuiceGenericLoader.java | 12 +- .../james/modules/server/JMXServerModule.java | 10 +- .../james/modules/data/JPADomainListModule.java | 8 +- .../data/JPARecipientRewriteTableModule.java | 6 +- .../modules/data/JPAUsersRepositoryModule.java | 8 +- .../java/org/apache/james/JPAJamesServerMain.java | 2 + .../java/org/apache/james/JPAJamesServerMain.java | 4 +- .../james/modules/mailbox/DefaultEventModule.java | 6 +- .../modules/mailbox/MailboxListenerFactory.java | 2 +- .../modules/mailbox/PreDeletionHookLoaderImpl.java | 2 +- .../modules/server/CamelMailetContainerModule.java | 18 +- .../org/apache/james/utils/GuiceMailetLoader.java | 2 +- .../org/apache/james/utils/GuiceMatcherLoader.java | 2 +- server/container/guice/memory-guice/pom.xml | 6 + .../org/apache/james/MemoryJamesServerMain.java | 4 +- .../james/modules/data/MemoryDataJmapModule.java | 2 +- .../james/modules/data/MemoryDataModule.java | 16 +- .../james/modules/mailbox/MemoryMailboxModule.java | 2 +- .../org/apache/james/GuiceJamesServerTest.java | 8 +- .../src/test/java/org/apache/james/MyRoute.java} | 17 +- ...rTest.java => WebAdminRoutesExtensionTest.java} | 39 ++- .../james/modules/protocols/IMAPServerModule.java | 8 +- .../modules/protocols/JMAPDraftServerModule.java | 8 +- .../james/modules/protocols/LMTPServerModule.java | 8 +- .../modules/protocols/ManageSieveServerModule.java | 8 +- .../james/modules/protocols/POP3ServerModule.java | 8 +- .../james/modules/protocols/SMTPServerModule.java | 8 +- server/container/guice/protocols/webadmin/pom.xml | 4 + .../modules/server/HealthCheckRoutesModule.java | 4 +- .../james/modules/server/WebAdminServerModule.java | 42 ++- ...urcesMigrationTaskAdditionalInformationDTO.java | 8 +- ...pingsSourcesMigrationTaskSerializationTest.java | 3 +- .../api/filtering/FilteringManagementContract.java | 22 +- .../rrt/lib/AbstractRecipientRewriteTableTest.java | 2 +- .../mailets/remote/delivery/DeliveryRunnable.java | 4 +- .../integration/AuthorizedEndpointsTest.java | 9 + ...dminServerTaskSerializationIntegrationTest.java | 11 +- .../CassandraMappingsSolveInconsistenciesTask.java | 7 +- ...sandraMappingsSolveInconsistenciesTaskTest.java | 2 +- .../james/webadmin/WebAdminConfiguration.java | 31 +- .../org/apache/james/webadmin/WebAdminServer.java | 34 ++- .../apache/james/webadmin/WebAdminServerTest.java | 102 +++++++ .../org/apache/james/webadmin/WebAdminUtils.java | 19 +- .../routes/DeletedMessagesVaultDeleteTask.java | 2 +- ...gesVaultDeleteTaskAdditionalInformationDTO.java | 18 +- .../routes/DeletedMessagesVaultDeleteTaskDTO.java | 7 +- .../routes/DeletedMessagesVaultExportTaskDTO.java | 7 +- .../routes/DeletedMessagesVaultRestoreTaskDTO.java | 8 +- ...edMessagesVaultDeleteTaskSerializationTest.java | 4 +- ...edMessagesVaultExportTaskSerializationTest.java | 2 +- ...dMessagesVaultRestoreTaskSerializationTest.java | 2 +- .../WebadminApiQuerySerializationContractTest.java | 2 +- ....java => EventDeadLettersRedeliverAllTask.java} | 58 +--- ...va => EventDeadLettersRedeliverAllTaskDTO.java} | 21 +- ...ava => EventDeadLettersRedeliverGroupTask.java} | 62 ++-- ... => EventDeadLettersRedeliverGroupTaskDTO.java} | 36 ++- ....java => EventDeadLettersRedeliverOneTask.java} | 64 ++-- ...va => EventDeadLettersRedeliverOneTaskDTO.java} | 43 ++- ...LettersRedeliveryTaskAdditionalInformation.java | 60 ++++ ...tersRedeliveryTaskAdditionalInformationDTO.java | 74 ++++- .../webadmin/service/EventDeadLettersService.java | 6 +- .../routes/EventDeadLettersRoutesTest.java | 10 +- .../service/EventDeadLettersRedeliverTaskTest.java | 110 ++++--- ...ClearMailQueueTaskAdditionalInformationDTO.java | 2 +- .../webadmin/service/ClearMailQueueTaskDTO.java | 9 +- .../service/DeleteMailsFromMailQueueTaskDTO.java | 6 +- .../webadmin/service/ClearMailQueueTaskTest.java | 6 +- .../service/DeleteMailsFromMailQueueTaskTest.java | 8 +- .../webadmin/service/ClearMailRepositoryTask.java | 18 ++ ...MailRepositoryTaskAdditionalInformationDTO.java | 2 +- .../service/ClearMailRepositoryTaskDTO.java | 15 +- .../service/ReprocessingAllMailsTaskDTO.java | 8 +- ...cessingOneMailTaskAdditionalInformationDTO.java | 2 +- .../service/ReprocessingOneMailTaskDTO.java | 8 +- .../service/ClearMailRepositoryTaskTest.java | 9 +- .../service/ReprocessingAllMailsTaskTest.java | 6 +- .../service/ReprocessingOneMailTaskTest.java | 6 +- .../queue/rabbitmq/RabbitMQMailQueueFactory.java | 8 +- .../apache/james/task/TaskExecutionDetails.scala | 35 +-- .../org/apache/james/task/MemoryReferenceTask.java | 6 + .../james/task/MemoryReferenceWithCounterTask.java | 92 ++++++ .../org/apache/james/task/TaskManagerContract.java | 61 ++++ .../distributed/RabbitMQExclusiveConsumer.java | 6 +- .../distributed/RabbitMQWorkQueue.java | 39 ++- .../distributed/TasksSerializationModule.java | 37 ++- .../CassandraTaskExecutionDetailsProjection.scala | 3 +- ...assandraTaskExecutionDetailsProjectionDAO.scala | 53 ++-- .../distributed/RabbitMQWorkQueueSupplier.scala | 3 +- .../eventsourcing/distributed/TaskEventDTO.scala | 50 +++- ...andraTaskExecutionDetailsProjectionDAOTest.java | 4 +- ...assandraTaskExecutionDetailsProjectionTest.java | 9 +- .../distributed/DistributedTaskManagerTest.java | 14 +- .../RabbitMQTerminationSubscriberTest.java | 4 +- .../distributed/RabbitMQWorkQueueTest.java | 31 +- .../distributed/TaskEventsSerializationTest.java | 26 +- .../JsonTaskAdditionalInformationsSerializer.java | 3 +- .../james/server/task/json/JsonTaskSerializer.java | 3 +- ...nceWithCounterTaskAdditionalInformationDTO.java | 40 +-- ...java => MemoryReferenceWithCounterTaskDTO.java} | 8 +- ...va => MemoryReferenceWithCounterTaskStore.java} | 12 +- .../server/task/json/dto/TestTaskDTOModules.java | 12 +- .../org/apache/james/task/MemoryTaskManager.java | 21 +- .../apache/james/task/SerialTaskManagerWorker.java | 20 +- .../org/apache/james/task/TaskManagerWorker.java | 13 +- .../james/task/eventsourcing/CommandHandlers.scala | 6 +- .../eventsourcing/EventSourcingTaskManager.scala | 4 +- .../apache/james/task/eventsourcing/Events.scala | 17 +- .../james/task/eventsourcing/TaskAggregate.scala | 13 +- .../james/task/eventsourcing/TaskCommand.scala | 43 +-- .../TaskExecutionDetailsProjection.scala | 7 +- .../task/eventsourcing/WorkerStatusListener.scala | 23 +- .../james/task/SerialTaskManagerWorkerTest.java | 9 +- .../TerminationSubscriberContract.java | 8 +- .../james/task/TaskExecutionDetailsFixture.scala | 12 +- src/site/xdoc/server/config-webadmin.xml | 3 + src/site/xdoc/server/dev-extend-mailet.xml | 96 +++--- src/site/xdoc/server/dev-extend.xml | 55 ++++ 215 files changed, 3056 insertions(+), 2075 deletions(-) create mode 100644 mailbox/elasticsearch/src/test/resources/eml/htmlContent.txt rename mailbox/{memory/src/main/java/org/apache/james/mailbox/inmemory => store/src/main/java/org/apache/james/mailbox/store/extractor}/JsoupTextExtractor.java (60%) rename mailbox/{memory/src/test/java/org/apache/james/mailbox/inmemory => store/src/test/java/org/apache/james/mailbox/store/extractor}/JsoupTextExtractorTest.java (58%) rename mailbox/{memory => store}/src/test/resources/documents/html.txt (100%) rename server/container/guice/cassandra-rabbitmq-guice/src/main/java/org/apache/james/{ => modules}/DistributedTaskManagerModule.java (65%) create mode 100644 server/container/guice/cassandra-rabbitmq-guice/src/main/java/org/apache/james/modules/TaskSerializationModule.java rename server/container/guice/configuration/src/main/java/org/apache/james/utils/{InitialisationOperation.java => InitializationOperation.java} (93%) copy server/container/guice/{guice-common/src/main/java/org/apache/james/utils/Startables.java => configuration/src/main/java/org/apache/james/utils/InitilizationOperationBuilder.java} (59%) copy server/container/guice/{jpa-guice/src/test/java/org/apache/james/JPAJamesServerWithSqlValidationTest.java => memory-guice/src/test/java/org/apache/james/MyRoute.java} (76%) copy server/container/guice/memory-guice/src/test/java/org/apache/james/{DefaultMemoryJamesServerTest.java => WebAdminRoutesExtensionTest.java} (61%) copy server/protocols/webadmin/webadmin-mailbox/src/main/java/org/apache/james/webadmin/service/{EventDeadLettersRedeliverTask.java => EventDeadLettersRedeliverAllTask.java} (59%) copy server/protocols/webadmin/webadmin-mailbox/src/main/java/org/apache/james/webadmin/service/{EventDeadLettersRedeliverTaskDTO.java => EventDeadLettersRedeliverAllTaskDTO.java} (72%) copy server/protocols/webadmin/webadmin-mailbox/src/main/java/org/apache/james/webadmin/service/{EventDeadLettersRedeliverTask.java => EventDeadLettersRedeliverGroupTask.java} (61%) copy server/protocols/webadmin/webadmin-mailbox/src/main/java/org/apache/james/webadmin/service/{EventDeadLettersRedeliverTaskDTO.java => EventDeadLettersRedeliverGroupTaskDTO.java} (57%) rename server/protocols/webadmin/webadmin-mailbox/src/main/java/org/apache/james/webadmin/service/{EventDeadLettersRedeliverTask.java => EventDeadLettersRedeliverOneTask.java} (64%) rename server/protocols/webadmin/webadmin-mailbox/src/main/java/org/apache/james/webadmin/service/{EventDeadLettersRedeliverTaskDTO.java => EventDeadLettersRedeliverOneTaskDTO.java} (51%) create mode 100644 server/protocols/webadmin/webadmin-mailbox/src/main/java/org/apache/james/webadmin/service/EventDeadLettersRedeliveryTaskAdditionalInformation.java create mode 100644 server/task/task-api/src/test/java/org/apache/james/task/MemoryReferenceWithCounterTask.java copy backends-common/cassandra/src/main/java/org/apache/james/backends/cassandra/migration/MigrationTaskAdditionalInformationsDTO.java => server/task/task-json/src/test/java/org/apache/james/server/task/json/dto/MemoryReferenceWithCounterTaskAdditionalInformationDTO.java (54%) copy server/task/task-json/src/test/java/org/apache/james/server/task/json/dto/{MemoryReferenceTaskDTO.java => MemoryReferenceWithCounterTaskDTO.java} (85%) copy server/task/task-json/src/test/java/org/apache/james/server/task/json/dto/{MemoryReferenceTaskStore.java => MemoryReferenceWithCounterTaskStore.java} (82%) --------------------------------------------------------------------- To unsubscribe, e-mail: server-dev-unsubscr...@james.apache.org For additional commands, e-mail: server-dev-h...@james.apache.org