Re: Windows OS platform support

2017-07-18 Thread Matt Andruff
This is a really common issue with windows. You can try turning off backups/virus scanning of that folder and sometimes this relieves the issue. (I assume there is a file attribute you can alter.) It's probably the case that Kafka itself has the file open, as linux does not have issues if you mo

Re: Windows OS platform support

2017-07-17 Thread M. Manna
d own logic to place the data into SQL. > > As you suggested, we will do some basic analysis by running Kafka for > longer duration continuously along with log cleanup activities based on SLA. > > > Thanks > Harish > > On Mon, 7/17/17, M. Manna wrote: > > Subject:

Re: Windows OS platform support

2017-07-17 Thread harish jadhav
ously along with log cleanup activities based on SLA. Thanks Harish On Mon, 7/17/17, M. Manna wrote: Subject: Re: Windows OS platform support To: "harish jadhav" Cc: "Kafka Users" Date: Monday, July 17, 2017, 6:20 PM Okay and are you using Kafka Connect (with JDBC c

Re: Windows OS platform support

2017-07-17 Thread M. Manna
sepearte utility. > > My only concern is that - as document suggests running kafka on windows > has some issues hence not able to decide on using it on windows production > bed. > > Thanks > Harish > > > > On Mon, 7/17/17, M. Manna wrote: > > Subject: Re

Re: Windows OS platform support

2017-07-17 Thread harish jadhav
uction bed. Thanks Harish On Mon, 7/17/17, M. Manna wrote: Subject: Re: Windows OS platform support To: "harish jadhav" Cc: "Kafka Users" Date: Monday, July 17, 2017, 4:04 PM I have never said that that we shouldn't use Kafka officially for Windows Production En

Re: Windows OS platform support

2017-07-17 Thread M. Manna
I have never said that that we shouldn't use Kafka officially for Windows Production Environment. I am running a major PoC which involves developing solution on Windows 10 - but my production docker containers are using Alpine Linux so I won't have any issues for the final integration pipeline. Wh

Re: Windows OS platform support

2017-07-17 Thread harish jadhav
Hello M.Manna, Do you mean we should not use Kafka in windows production until the disk I/O issues(For which you have given workaround) are resolved officilally? ThanksHarish On Monday, July 17, 2017, 5:31:11 PM GMT+5:30, M. Manna wrote: The workaround is to download the sources and create a

Re: Windows OS platform support

2017-07-17 Thread harish jadhav
Hello M.Manna, Thanks for your quick and valuable response. Actually I am getting following error - Caused by: java.nio.file.FileSystemException: \tmp\kafka-logs\TopicName-2\7262.log-> \tmp\kafka-logs\TopicName -2\7262.log.deleted: Theprocess cannot access the f

Re: Windows OS platform support

2017-07-17 Thread M. Manna
Hi, First I apologise and should just correct myself. I should use "Disk/File level operations" instead of using "I/O" since that refers to different things. What I mean to say that file deletion/renaming doesn't work even when you provide full permissions in Windows. But Unix/Linux based system

Re: Windows OS platform support

2017-07-17 Thread harish jadhav
Hi M.Manna, Thanks for the update. If possible, can you please share which admin I/O level functionality will impact? Do you mean something related to log files renaming? In documentation, there is no pointer with respect to I/O. Kindly advice. ThanksHarish On Saturday, July 15, 2017, 1:59:5

Re: Windows OS platform support

2017-07-15 Thread M. Manna
Kafka has some issues wuth IO level admin functionalities e.g. file deletion/renaming doesn't work out of the box like Linux. However, user base is growing and there's a momentum to support Windows OS seamlessly like Linux. I have been running some stress tests on Windows and the performance is qu

Re: Windows OS platform support

2017-07-14 Thread Eno Thereska
Hi Harish, I believe many people/orgs use it on Windows. We rely on the community to test/fix/answer any Windows questions, same as with Linux or MacOS. However, based on what I've observed, perhaps there are more people answering Linux-related questions. Eno > On 14 Jul 2017, at 13:24, haris

Windows OS platform support

2017-07-14 Thread harish jadhav
Hello Team, I am exploring Apache Kafka and found that one of the best MQ I have encountered. I was exploring option to use it in Windows machine and started some kind of proof of concept work referring installation section on windows and it work perfectly. Later realized that Kafka documentati