Re: [Dev] [Architecture] WSO2 IoT Server 1.0.0-alpha Released

2016-05-22 Thread Ayyoob Hamza 
Hi Dulitha,
It seems that hadoop.home.dir not set in windows. This error get triggered
when the spark context initialise. However It seems like hadoop is not
needed and has been crept into the pack with the installation of analytics
datasource feature. We can remove hbase feature from this, thanks for
pointing out, could you please raise a JIRA on this[1].

[1] https://wso2.org/jira/browse/IOTS

*Ayyoob Hamza*
*Software Engineer*
WSO2 Inc.; http://wso2.com
email: ayy...@wso2.com cell: +94 77 1681010 <%2B94%2077%207779495>
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] [Architecture] WSO2 IoT Server 1.0.0-alpha Released

2016-05-20 Thread Sumedha Rubasinghe 
Dulitha,
Just to reconfirm. This is on Windows. right?

On Sat, May 21, 2016 at 1:04 AM, Dulitha Wijewantha 
wrote:

> Hi guys,
> Getting below error in startup. Any idea how hadoop crept into the pack?
> Cheers~
>
> [2016-05-20 14:48:48,984] ERROR - Shell Failed to locate the winutils
> binary in the hadoop binary path
> java.io.IOException: Could not locate executable null\bin\winutils.exe in
> the Hadoop binaries.
> at org.apache.hadoop.util.Shell.getQualifiedBinPath(Shell.java:355)
> at org.apache.hadoop.util.Shell.getWinUtilsPath(Shell.java:370)
> at org.apache.hadoop.util.Shell.(Shell.java:363)
> at org.apache.hadoop.util.StringUtils.(StringUtils.java:79)
> at
> org.apache.hadoop.security.Groups.parseStaticMapping(Groups.java:104)
> at org.apache.hadoop.security.Groups.(Groups.java:86)
> at org.apache.hadoop.security.Groups.(Groups.java:66)
> at
> org.apache.hadoop.security.Groups.getUserToGroupsMappingService(Groups.java:280)
> at
> org.apache.hadoop.security.UserGroupInformation.initialize(UserGroupInformation.java:271)
> at
> org.apache.hadoop.security.UserGroupInformation.ensureInitialized(UserGroupInformation.java:248)
> at
> org.apache.hadoop.security.UserGroupInformation.loginUserFromSubject(UserGroupInformation.java:763)
> at
> org.apache.hadoop.security.UserGroupInformation.getLoginUser(UserGroupInformation.java:748)
> at
> org.apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:621)
> at
> org.apache.spark.util.Utils$$anonfun$getCurrentUserName$1.apply(Utils.scala:2042)
> at
> org.apache.spark.util.Utils$$anonfun$getCurrentUserName$1.apply(Utils.scala:2042)
> at scala.Option.getOrElse(Option.scala:120)
> at
> org.apache.spark.util.Utils$.getCurrentUserName(Utils.scala:2042)
> at org.apache.spark.SparkContext.(SparkContext.scala:301)
> at
> org.apache.spark.api.java.JavaSparkContext.(JavaSparkContext.scala:61)
> at
> org.wso2.carbon.analytics.spark.core.internal.SparkAnalyticsExecutor.initializeSparkContext(SparkAnalyticsExecutor.java:346)
> at
> org.wso2.carbon.analytics.spark.core.internal.SparkAnalyticsExecutor.initializeClient(SparkAnalyticsExecutor.java:359)
> at
> org.wso2.carbon.analytics.spark.core.internal.SparkAnalyticsExecutor.initializeSparkServer(SparkAnalyticsExecutor.java:188)
> at
> org.wso2.carbon.analytics.spark.core.internal.AnalyticsComponent.activate(AnalyticsComponent.java:77)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> at
> org.eclipse.equinox.internal.ds.model.ServiceComponent.activate(ServiceComponent.java:260)
> at
> org.eclipse.equinox.internal.ds.model.ServiceComponentProp.activate(ServiceComponentProp.java:146)
> at
> org.eclipse.equinox.internal.ds.model.ServiceComponentProp.build(ServiceComponentProp.java:345)
> at
> org.eclipse.equinox.internal.ds.InstanceProcess.buildComponent(InstanceProcess.java:620)
> at
> org.eclipse.equinox.internal.ds.InstanceProcess.buildComponents(InstanceProcess.java:197)
> at
> org.eclipse.equinox.internal.ds.Resolver.getEligible(Resolver.java:343)
> at
> org.eclipse.equinox.internal.ds.SCRManager.serviceChanged(SCRManager.java:222)
> at
> org.eclipse.osgi.internal.serviceregistry.FilteredServiceListener.serviceChanged(FilteredServiceListener.java:107)
> at
> org.eclipse.osgi.framework.internal.core.BundleContextImpl.dispatchEvent(BundleContextImpl.java:861)
> at
> org.eclipse.osgi.framework.eventmgr.EventManager.dispatchEvent(EventManager.java:230)
> at
> org.eclipse.osgi.framework.eventmgr.ListenerQueue.dispatchEventSynchronous(ListenerQueue.java:148)
> at
> org.eclipse.osgi.internal.serviceregistry.ServiceRegistry.publishServiceEventPrivileged(ServiceRegistry.java:819)
> at
> org.eclipse.osgi.internal.serviceregistry.ServiceRegistry.publishServiceEvent(ServiceRegistry.java:771)
> at
> org.eclipse.osgi.internal.serviceregistry.ServiceRegistrationImpl.register(ServiceRegistrationImpl.java:130)
> at
> org.eclipse.osgi.internal.serviceregistry.ServiceRegistry.registerService(ServiceRegistry.java:214)
> at
> org.eclipse.osgi.framework.internal.core.BundleContextImpl.registerService(BundleContextImpl.java:433)
> at
> org.eclipse.osgi.framework.internal.core.BundleContextImpl.registerService(BundleContextImpl.java:451)
> at
> org.eclipse.osgi.framework.internal.core.BundleContextImpl.registerService(BundleContextImpl.java:950)
> at
>

Re: [Dev] [Architecture] WSO2 IoT Server 1.0.0-alpha Released

2016-05-20 Thread Dulitha Wijewantha 
Hi guys,
Getting below error in startup. Any idea how hadoop crept into the pack?
Cheers~

[2016-05-20 14:48:48,984] ERROR - Shell Failed to locate the winutils
binary in the hadoop binary path
java.io.IOException: Could not locate executable null\bin\winutils.exe in
the Hadoop binaries.
at org.apache.hadoop.util.Shell.getQualifiedBinPath(Shell.java:355)
at org.apache.hadoop.util.Shell.getWinUtilsPath(Shell.java:370)
at org.apache.hadoop.util.Shell.(Shell.java:363)
at org.apache.hadoop.util.StringUtils.(StringUtils.java:79)
at
org.apache.hadoop.security.Groups.parseStaticMapping(Groups.java:104)
at org.apache.hadoop.security.Groups.(Groups.java:86)
at org.apache.hadoop.security.Groups.(Groups.java:66)
at
org.apache.hadoop.security.Groups.getUserToGroupsMappingService(Groups.java:280)
at
org.apache.hadoop.security.UserGroupInformation.initialize(UserGroupInformation.java:271)
at
org.apache.hadoop.security.UserGroupInformation.ensureInitialized(UserGroupInformation.java:248)
at
org.apache.hadoop.security.UserGroupInformation.loginUserFromSubject(UserGroupInformation.java:763)
at
org.apache.hadoop.security.UserGroupInformation.getLoginUser(UserGroupInformation.java:748)
at
org.apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:621)
at
org.apache.spark.util.Utils$$anonfun$getCurrentUserName$1.apply(Utils.scala:2042)
at
org.apache.spark.util.Utils$$anonfun$getCurrentUserName$1.apply(Utils.scala:2042)
at scala.Option.getOrElse(Option.scala:120)
at org.apache.spark.util.Utils$.getCurrentUserName(Utils.scala:2042)
at org.apache.spark.SparkContext.(SparkContext.scala:301)
at
org.apache.spark.api.java.JavaSparkContext.(JavaSparkContext.scala:61)
at
org.wso2.carbon.analytics.spark.core.internal.SparkAnalyticsExecutor.initializeSparkContext(SparkAnalyticsExecutor.java:346)
at
org.wso2.carbon.analytics.spark.core.internal.SparkAnalyticsExecutor.initializeClient(SparkAnalyticsExecutor.java:359)
at
org.wso2.carbon.analytics.spark.core.internal.SparkAnalyticsExecutor.initializeSparkServer(SparkAnalyticsExecutor.java:188)
at
org.wso2.carbon.analytics.spark.core.internal.AnalyticsComponent.activate(AnalyticsComponent.java:77)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at
org.eclipse.equinox.internal.ds.model.ServiceComponent.activate(ServiceComponent.java:260)
at
org.eclipse.equinox.internal.ds.model.ServiceComponentProp.activate(ServiceComponentProp.java:146)
at
org.eclipse.equinox.internal.ds.model.ServiceComponentProp.build(ServiceComponentProp.java:345)
at
org.eclipse.equinox.internal.ds.InstanceProcess.buildComponent(InstanceProcess.java:620)
at
org.eclipse.equinox.internal.ds.InstanceProcess.buildComponents(InstanceProcess.java:197)
at
org.eclipse.equinox.internal.ds.Resolver.getEligible(Resolver.java:343)
at
org.eclipse.equinox.internal.ds.SCRManager.serviceChanged(SCRManager.java:222)
at
org.eclipse.osgi.internal.serviceregistry.FilteredServiceListener.serviceChanged(FilteredServiceListener.java:107)
at
org.eclipse.osgi.framework.internal.core.BundleContextImpl.dispatchEvent(BundleContextImpl.java:861)
at
org.eclipse.osgi.framework.eventmgr.EventManager.dispatchEvent(EventManager.java:230)
at
org.eclipse.osgi.framework.eventmgr.ListenerQueue.dispatchEventSynchronous(ListenerQueue.java:148)
at
org.eclipse.osgi.internal.serviceregistry.ServiceRegistry.publishServiceEventPrivileged(ServiceRegistry.java:819)
at
org.eclipse.osgi.internal.serviceregistry.ServiceRegistry.publishServiceEvent(ServiceRegistry.java:771)
at
org.eclipse.osgi.internal.serviceregistry.ServiceRegistrationImpl.register(ServiceRegistrationImpl.java:130)
at
org.eclipse.osgi.internal.serviceregistry.ServiceRegistry.registerService(ServiceRegistry.java:214)
at
org.eclipse.osgi.framework.internal.core.BundleContextImpl.registerService(BundleContextImpl.java:433)
at
org.eclipse.osgi.framework.internal.core.BundleContextImpl.registerService(BundleContextImpl.java:451)
at
org.eclipse.osgi.framework.internal.core.BundleContextImpl.registerService(BundleContextImpl.java:950)
at
org.wso2.carbon.analytics.dataservice.core.AnalyticsDataServiceComponent.activate(AnalyticsDataServiceComponent.java:69)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at

[Dev] [Architecture] WSO2 IoT Server 1.0.0-alpha Released

2016-05-20 Thread Ayyoob Hamza 
*WSO2 IoT Server 1.0.0 Alpha Released*
We are pleased to announce WSO2 IoT Server 1.0.0 alpha release. It can be
downloaded from
https://github.com/wso2/product-iots/releases/tag/v1.0.0-alpha

WSO2 IoT Server is an extensible, open-source, multi tenant, Internet of
Things Platform for implementing server-side of IoT Reference Architecture.
It comes with a reference implementations for the device layer.


WSO2 IoT Server supports:



   -

   Device Management
   -

  Extensions for registering device types
  -

  Self-service enrolment and management of connected devices
  -

  Group, manage and monitor connected devices
  -

  Share device operations / data with other users
  -

  Distribution and management of applications and firmware to devices
  -

  OOTB support for some known device types such as Raspberry Pi,
  Arduino Uno, Android


   -

   IoT Protocol Support
   -

  Leverage MQTT, HTTP, Websockets and XMPP protocols for device
  communications with IoT Server
  -

  Framework extension for adding more protocols and data formats
  -

   Analytics
   -

  Support for batch, interactive, real-time and predictive analytics
  through WSO2 DAS
  -

   Pre-built visualisation support for sensor readings
   -

  View instant, visualised statistics of individual or multiple devices
  -

  Traverse through, analyse and zoom in/out of filtered data
  -

  Stats-API to write your own visualisation
  -

  Pre-built graphs for common sensor reading types like temperature,
  velocity
  -

   API Management for App Development
   -

  Devices are represented as REST APIs
  -

  Develop applications using Device APIs
  -

   Identity and Access Management
   -

  Identity Management for devices
  -

  Token based access control for devices & operations (protect back end
  services via exposing device type APIs)
  - Support for SCEP protocol (encryption and authenticity)



List of known issues

- https://wso2.org/jira/issues/?filter=13055

Bug Fixes

   - [IOTS-17 ] - MQTT endpoints are
   not secured for agent communication
   - [IOTS-19 ] - XMPP sessions not
   closed before server shutdown
   - [IOTS-21 ] - Jaggery API calls
   are not secured
   - [IOTS-34 ] - Backend Service
   Invoker Fails Intermittently with Unexpected token: <
   - [IOTS-37 ] - Could not generate
   a new access token (using refresh token) by using the current token endpoint
   - [IOTS-47 ] - Update the release
   note in the release packs as it is about EMM
   - [IOTS-50 ] - users whos
   iot-admin role is removed is shown all options for enrol devices as users
   with iot-admin role
   - [IOTS-55 ] - Considerable delay
   in server startup
   - [IOTS-57 ] - Error when starting
   the IOT pack after pointing to the mysql database
   - [IOTS-64 ] - The wso2carbon log
   file is growing rapidly
   - [IOTS-68 ] - when a tenant is
   created with the same user name as super tenant seems the super tenant data
   are shown
   - [IOTS-69 ] - until device admin
   was disabled the camera policy was in effect preventing the use of camera
   on android device
   - [IOTS-75 ] - view API throws a
   Caused by: java.lang.NullPointerException: Tenant domain has not been set
   in CarbonContext
   - [IOTS-81 ] - IOT devices are
   allways in active status
   - [IOTS-92 ] - Error in executing
   task: Table Not Found: X1234_DeviceBatterySummaryData
   java.lang.RuntimeException: Table Not Found: X1234_DeviceBatterySummaryData
   is thown when pointing to mysql
   - [IOTS-93 ] - XMPP server details
   are hardcoded in virtual fire alarm and devicemgt-config.xml file
   - [IOTS-94 ] - Virtual firealarms
   that were downloaded before xmpp was enabled can not connect to xmpp
   protocol after enabling.
   - [IOTS-100 ] - When integrating
   ActiveMQ as an external message broker IOTS fails to start
   - [IOTS-102 ] - Device analytic
   line graph does not get generated when the device type has a capital letter
   - [IOTS-104 ] - Remove the device
   type configs that is used for UI from conf directory
   - [IOTS-105