[dpdk-dev] We are so glad, we chose DPDK for our Data Plane

2015-07-04 Thread Matthew Hall
Hello Venkat, I'd like to ask one question about your project. What did you do to make poll-mode drivers for WLAN controllers? I didn't think DPDK had these by default and it could be quite nice for high-speed protocols such as 802.11N. Thanks, Matthew. On Jul 3, 2015, at 9:10 PM, Venkateswar

[dpdk-dev] We are so glad, we chose DPDK for our Data Plane

2015-07-05 Thread Matthew Hall
e using DPDK only to process the tunneled wireless data packets from > AP. > > We added a tunnel layer on top of the PMDs, to process the tunneled packets. > > Thanks > Venkat > > > > On 5 July 2015 at 11:08, Matthew Hall wrote: > > > Hello Venk

[dpdk-dev] librte_power w/ intel_pstate cpufreq governor

2016-01-02 Thread Matthew Hall
doing performance / production quality improvements on my code, without some kind of basic help understanding how this librte_power stuff should work. Thanks, Matthew. On 12/5/15 4:08 PM, Matthew Hall wrote: > Hello all, > > I wanted to ask some questions about librte_power and the great

[dpdk-dev] OK to reindent the pktgen (mix of tabs and spaces, etc.)?

2016-01-03 Thread Matthew Hall
thew. On 11/22/15 11:10 PM, Matthew Hall wrote: > I would like to reindent it using the following astyle command, with a few > small hand edits past that level, to get it closer to most other DPDK code as > the inconsistent mix of tabs, spaces, etc. makes it difficult to read and &g

[dpdk-dev] [PKTGEN] OK to reindent the pktgen (mix of tabs and spaces, etc.)?

2016-01-03 Thread Matthew Hall
On 1/3/16 9:09 AM, Wiles, Keith wrote: > Pktgen is setup for tabs for 4 (with replace tabs with spaces), using tab > stop of 8 is just wrong IMO :-) > Just started using kdevelop instead of eclipse, so I may have corrupted the > style some :-( The problem I found was a number of files had an inc

[dpdk-dev] UX Bug in Sphinx HTML Layout for Programming Guide (and maybe other guides?)

2016-01-13 Thread Matthew Hall
When you go to this link: http://dpdk.org/doc/guides/prog_guide/perf_opt_guidelines.html There is a bug in the Sphinx layout, where the subchapters of a chapter are invisible even after the chapter is clicked. It is a pain when you are trying to figure out the different sections in a widely var

[dpdk-dev] rte_prefetch0() is effective?

2016-01-13 Thread Matthew Hall
On Wed, Jan 13, 2016 at 11:34:33AM +, Bruce Richardson wrote: > When the first example apps using this style of prefetch were originally > written, yes, there was a noticable performance increase achieved by using > the prefetch. Thereafter, I'm not sure that anyone has checked with each > g

[dpdk-dev] librte_power w/ intel_pstate cpufreq governor

2016-01-14 Thread Matthew Hall
On Tue, Jan 12, 2016 at 03:17:21PM +, Zhang, Helin wrote: > Hi Matthew > > Yes, you have indicated out the key, the power management module has changed > or upgraded. > Could you help to try the legacy one to see if it still works, as indicated > in your link? I can do this, but according t

[dpdk-dev] librte_power w/ intel_pstate cpufreq governor

2016-01-14 Thread Matthew Hall
On Thu, Jan 14, 2016 at 02:03:55AM -0500, Matthew Hall wrote: > Yes, let me know how I could help. I don't know very much yet. My machine is > Skylake Core i7-6700k. Unfortunately I think I am in trouble here, because > there is no whitepaper on the Intel website for Intel Speed Sh

[dpdk-dev] librte_power w/ intel_pstate cpufreq governor

2016-01-14 Thread Matthew Hall
On Thu, Jan 14, 2016 at 07:15:51AM +, Zhang, Helin wrote: > That's disappointing if Skylake is like that. Let's have a learning first, > and then check if we can fix that. But in addition, DPDK provide interrupt > based packet receiving mechanism, can it be one of your choice? Maybe I am wro

[dpdk-dev] Sending and receiving on the same port at the same time, from different threads

2016-01-15 Thread Matthew Hall
On Fri, Jan 15, 2016 at 04:54:11PM +, Zoltan Kiss wrote: > Can you call rte_eth_tx_burst() and rte_eth_tx_burst() on the same port at > the same time from different threads? In general, yes you can. I did this before in an L4-L7 performance tester, so cores could concentrate on RX or TX to k

[dpdk-dev] Missing Outstanding Patches (By Me) In Patchwork

2016-01-19 Thread Matthew Hall
I have some outstanding minor patches which do not appear in Patchwork anywhere I can see but the interface is also pretty confusing. Is there a way to find all patches by a person throughout time so I can see what happened to them and check why they are not listed and also not merged (that I a

[dpdk-dev] [PATCH] rte.extvars.mk: allow overriding RTE_SDK_BIN from the environment

2016-01-19 Thread Matthew Hall
Currently pktgen-dpdk and many other external apps will fail to compile if the build output directory name is not equal to the target name. This causes problems if you used an alternative build output directory. Signed-off-by: Matthew Hall --- mk/internal/rte.extvars.mk | 2 +- 1 file changed

[dpdk-dev] Missing Outstanding Patches (By Me) In Patchwork

2016-01-19 Thread Matthew Hall
Board, etc. as Patchwork seems rather old and difficult to use from my experience with it so far. Sincerely, Matthew. On 1/19/16 9:20 PM, Matthew Hall wrote: > I have some outstanding minor patches which do not appear in Patchwork > anywhere I can see but the interface is also pretty confus

[dpdk-dev] [PKTGEN] fixing weird termio issues that complicate debugging

2016-01-19 Thread Matthew Hall
c_socket(buff, (sizeof(pkt_seq_t) * NUM_TOTAL_PKTS), RTE_CACHE_LINE_SIZE, rte_socket_id()); Thoughts? Matthew Hall

[dpdk-dev] igb: correctly setting default value TX_WTHRESH (due to performance warning during PMD init)

2016-01-19 Thread Matthew Hall
re you forced to set TX_WTHRESH by hand for igb? What sane default value one should pick for this setting? Could we do something better to auto-select this like we did for most rx_conf / tx_conf settings previously? Or did I miss something about the usability changes or do something wrong? Since

[dpdk-dev] Status of Linux Foundation

2016-01-20 Thread Matthew Hall
Hello, I was just reading the following blog post about downscaling community involvement at the Linux Foundation. http://mjg59.dreamwidth.org/39546.html I wondered if any of issues discussed there this might be relevant for the governance efforts moving forward on DPDK? Sincerely, Matthew.

[dpdk-dev] [PKTGEN] fixing weird termio issues that complicate debugging

2016-01-20 Thread Matthew Hall
On 1/20/16 8:26 AM, Wiles, Keith wrote: > One problem is a number of people wanted to steal the code and use in a paid > application, so the copyright is some what a requirement. As you may know I > do a lot of debugging on Pktgen and I feel they are a nuisance. I can try to > see if we can clea

[dpdk-dev] [PATCH] rte.extvars.mk: allow overriding RTE_SDK_BIN from the environment

2016-01-20 Thread Matthew Hall
On 1/20/16 7:27 AM, Thomas Monjalon wrote: > Hi Matthew, > > RTE_SDK_BIN is an internal variable and should not be overriden. > > Have you installed DPDK somewhere? Example: > make install O=mybuild DESTDIR=mylocalinstall > > Then you should build your app like this: > make RTE_SDK=$(r

[dpdk-dev] [PKTGEN] [PATCH 1/2] usage_pktgen.rst: multiple instances: clean up section intro

2016-01-20 Thread Matthew Hall
Signed-off-by: Matthew Hall --- docs/source/usage_pktgen.rst | 18 +- 1 file changed, 9 insertions(+), 9 deletions(-) diff --git a/docs/source/usage_pktgen.rst b/docs/source/usage_pktgen.rst index 20bd314..efe8aa4 100644 --- a/docs/source/usage_pktgen.rst +++ b/docs/source

[dpdk-dev] [PKTGEN] [PATCH 2/2] usage_pktgen.rst: multiple instances: clarify EAL options needed

2016-01-20 Thread Matthew Hall
Signed-off-by: Matthew Hall --- docs/source/usage_pktgen.rst | 15 +++ 1 file changed, 15 insertions(+) diff --git a/docs/source/usage_pktgen.rst b/docs/source/usage_pktgen.rst index efe8aa4..223d033 100644 --- a/docs/source/usage_pktgen.rst +++ b/docs/source/usage_pktgen.rst

[dpdk-dev] [PKTGEN] additional terminal IO question

2016-01-20 Thread Matthew Hall
If I try using pktgen theme mode (-T) or unmodified, without commenting out some of the stuff I mentioned I disabled for debugging in the previous thread, it seems like it sets the pktgen prompt to be invisible (black text on black??? or I'm not sure just want) on my TTY which has a black backg

[dpdk-dev] [PKTGEN] additional terminal IO question

2016-01-20 Thread Matthew Hall
On 1/20/16 10:00 PM, Arnon Warshavsky wrote: > Black background gets me to the blind reset as well. > Pktgen is the only tab I keep with non black background.. Thanks for confirming. Never had this many termio issues before so I was wondering if I just went totally crazy! Matthew.

[dpdk-dev] [PKTGEN] dumb question: how to start packet TX and set the payload

2016-01-20 Thread Matthew Hall
Hello, I was trying to just use the default PKT file, test/set_seq.pkt, like so: sudo "./app/app/${RTE_TARGET}/pktgen" \ -l 2,3 \ --master-lcore 2 \ -n 2 \ -m 1024 \ -w 0a:00.1 \ --no-shconf \ --file-prefix pktgen \ -- \ -P \ -m 2.0 \ -f test/set_seq.pkt After pktgen loaded, the port 0 is marked

[dpdk-dev] [PATCH] eal: add function to check if primary proc alive

2016-01-20 Thread Matthew Hall
On 1/20/16 10:14 PM, Qiu, Michael wrote: > As we could start up many primaries, how does your secondary process > work with them? I just worked on this tonight myself. When doing > 1 primary (for example pktgen and app), I had to specify: --no-shconf --file-prefix pktgen --file-prefix app Or yo

[dpdk-dev] [PKTGEN] dumb question: how to start packet TX and set the payload

2016-01-21 Thread Matthew Hall
On Thu, Jan 21, 2016 at 03:05:38PM +, Wiles, Keith wrote: > Forgot to answer this one. Pktgen does not allow the user to define the > content of the packet per say only the fill pattern and what ever you > configure the packet type to be. If you would like to submit a patch for > adding user

[dpdk-dev] [PKTGEN] dumb question: how to start packet TX and set the payload

2016-01-21 Thread Matthew Hall
On Thu, Jan 21, 2016 at 03:01:33PM +, Wiles, Keith wrote: > The problem is you used the same core (2) for the -m option. Core 2 is being > used for the keyboard, timer and screen output. This means you must have the > -m option starting with core 3 as in -m 3.0 and your problem should go away

[dpdk-dev] [PKTGEN] fixing weird termio issues that complicate debugging

2016-01-21 Thread Matthew Hall
On Thu, Jan 21, 2016 at 11:00:14AM -0800, Stephen Hemminger wrote: > I would rip out the whole tty control and theming nonsense and then > just print one line copyright on startup. Personally, I might have put this sentiment more diplomatically, but a refactor effort such as this would make life

[dpdk-dev] [PKTGEN] dumb question: how to start packet TX and set the payload

2016-01-21 Thread Matthew Hall
On Thu, Jan 21, 2016 at 07:44:21PM +, Wiles, Keith wrote: > What type of data do you want to add to the packets? Now it builds > IPv4/UDP/TCP packets, do you need to replace UDP or TCP or just add more > protocol layers? I perform content inspection of various types: IPv4 - supported IPv6 -

[dpdk-dev] Future Direction for rte_eth_stats_get()

2016-01-22 Thread Matthew Hall
On Fri, Jan 22, 2016 at 06:02:24PM +0300, Igor Ryzhov wrote: > How about exposing stats according to IF-MIB? > > Statistics to be exposed are - octets, unicast packets, multicast packets, > broadcast packets, errors and discards for both TX and RX. > > These counters are basic and implemented by

[dpdk-dev] [PKTGEN] [PATCH 1/2] usage_pktgen.rst: multiple instances: clean up section intro

2016-01-22 Thread Matthew Hall
On Thu, Jan 21, 2016 at 03:46:21PM +, Wiles, Keith wrote: > It appears (if I compared the text correctly) the above only move a few > trailing words to the next line, why? I believe in trying to leave code / docs cleaner than I found them. Most Markdown / ReStructured Text has a tradition of

[dpdk-dev] [PKTGEN] additional terminal IO question

2016-01-22 Thread Matthew Hall
On Thu, Jan 21, 2016 at 05:35:00PM +0200, Arnon Warshavsky wrote: > Keith, > For the record, on my end (can only speak for myself) this is not a real > problem. > I work around it by using a different theme and live with it happily ever > after. > I just provided the input since I encountered it.

[dpdk-dev] [PKTGEN] additional terminal IO question

2016-01-25 Thread Matthew Hall
On Mon, Jan 25, 2016 at 10:20:42AM +0100, Andriy Berestovskyy wrote: > Hi Matthew, > Every software has bugs. pktgen is a great tool and we appreciate it as is. > > I would prefer we discuss a patch rather that questioning a > functionality implemented way ago... > > Andriy Sure patches are the

[dpdk-dev] Previous DPDK version API documentation for app developers

2015-02-11 Thread Matthew Hall
Hi all, I ran into a funny situation today with the API documentation. For stability until I can get my app mostly working, I was using DPDK 1.7.X, so I could concentrate on making the app reliable. But the DPDK website only has the API docs for DPDK 1.8.X / HEAD. I was wondering if we could h

[dpdk-dev] Intel DPDK support for ntop DPI

2015-02-16 Thread Matthew Hall
I did some research on this previously before concluding NDPI wouldn't help me much with my own particular application. Just for running NDPI DPDK is not strictly needed, as NDPI is normally read-only so something like PF_RING would work in default ntop / ndpi. If you're trying to use NDPI in a

[dpdk-dev] kernel: BUG: soft lockup - CPU#1 stuck for 22s! [kni_single:1782]

2015-02-16 Thread Matthew Hall
On Mon, Feb 16, 2015 at 10:33:52AM -0600, Jay Rolette wrote: > In kni_net_rx_normal(), it was calling netif_receive_skb() instead of > netif_rx(). The source for netif_receive_skb() point out that it should > only be called from soft-irq context, which isn't the case for KNI. For the uninitiated a

[dpdk-dev] Previous DPDK version API documentation for app developers

2015-02-17 Thread Matthew Hall
On Feb 12, 2015, at 1:29 AM, Thomas Monjalon wrote: > Yes you can: make doc > For doxygen API only: make doc-api-html > For sphinx only: doc-guides-html. Hi Thomas, In 1.7 for me at least I found the target was called: doc-htmlapi . Did the way this stuff works get changed at some point? Than

[dpdk-dev] Previous DPDK version API documentation for app developers

2015-02-17 Thread Matthew Hall
On Feb 17, 2015, at 1:30 AM, Thomas Monjalon wrote: > Yes, you're right. It has been renamed. > But I think you should better work on improving the HEAD ;) Yes, I agree. But to get to this point I have to get the core application features to even work in 1.7, before I can switch the app to 1.8.

[dpdk-dev] Appropriate DPDK data structures for TCP sockets

2015-02-21 Thread Matthew Hall
Hello fellow stack hackers :) , I'm working on a simple server-side implementation of TCP on DPDK. For this to work I need a good data structure to store some sockets. The lookup key is like this: struct ss_flow_key_s { uint8_t sip[IPV6_ALEN]; uint8_t dip[IPV6_ALEN]; uint16_t spor

[dpdk-dev] Appropriate DPDK data structures for TCP sockets

2015-02-22 Thread Matthew Hall
On Feb 22, 2015, at 4:02 PM, Stephen Hemminger wrote: > Use userspace RCU? or BSD RB_TREE Thanks Stephen, I think the RB_TREE stuff is single threaded mostly. But user-space RCU looks quite good indeed, I didn't know somebody ported it out of the kernel. I'll check it out. Matthew.

[dpdk-dev] Appropriate DPDK data structures for TCP sockets

2015-02-23 Thread Matthew Hall
On Mon, Feb 23, 2015 at 08:48:57AM -0600, Matt Laswell wrote: > Apologies in advance for likely being a bit long-winded. Long winded is great, helps me get context. > First, you really need to take cache performance into account when you're > choosing a data structure. Something like a balanced

[dpdk-dev] IPv6 Offload Capabilities

2015-01-05 Thread Matthew Hall
On Jan 4, 2015, at 11:56 PM, Gal Sagie wrote: > I noticed that in version 1.8, there are no flags to indicate IPv6 check > sum offloading > (only DEV_TX_OFFLOAD_IPV4_CKSUM) > which means TSO offloading is also not supported for IPv6. I need that feature too. Right now I disabled the IP checksum o

[dpdk-dev] IPv6 Offload Capabilities

2015-01-05 Thread Matthew Hall
On Mon, Jan 05, 2015 at 09:36:54AM +0100, Thomas Monjalon wrote: > Which checksum are you talking about? IPv6 checsum doesn't exist. The same computation algorithm must be reused to calculate the IPV6 Pseudoheader checksum when generating ICMPV6, UDPV6, and other L4 protocols whose definitions w

[dpdk-dev] IPv6 Offload Capabilities

2015-01-05 Thread Matthew Hall
On Mon, Jan 05, 2015 at 09:25:37PM -0800, Matthew Hall wrote: > The same computation algorithm must be reused to calculate the IPV6 > Pseudoheader checksum when generating ICMPV6, UDPV6, and other L4 protocols > whose definitions were retroactively modified to include the IPV6 >

[dpdk-dev] RTM instruction compile failure for XABORT when AVX is active

2015-06-28 Thread Matthew Hall
Hi all, I am getting a strange error compiling some RTM instructions when I upgraded my VM environment from VirtualBox 4 to VirtualBox 5 and AVX instructions from the host CPU became available. However when I am reading the opcode description for XABORT it supposedly allows an immediate operand

[dpdk-dev] RTM instruction compile failure for XABORT when AVX is active

2015-06-28 Thread Matthew Hall
It would appear there is some bug in the new lock elision patches that is preventing it from compiling with clang. Any suggestions? On Jun 28, 2015, at 10:16 AM, Matthew Hall wrote: > Hi all, > > I am getting a strange error compiling some RTM instructions when I upgraded > my VM

[dpdk-dev] Appropriate DPDK data structures for TCP sockets

2015-03-12 Thread Matthew Hall
On Mon, Feb 23, 2015 at 11:51:46PM +0200, Avi Kivity wrote: > https://github.com/cloudius-systems/seastar Hi Avi and others, My code unintentionally ended up looking somewhat like a C version of your seastar C++ code, even though I didn't really look at yours too much when I coded mine as it wa

[dpdk-dev] Symmetric RSS Hashing, Part 2

2015-03-14 Thread Matthew Hall
A few months ago we had this thread about symmetric hashing of TCP in RSS: http://dpdk.org/ml/archives/dev/2014-December/010148.html I was wondering if we ever did figure out how to get the 0x6d5a hash key mentioned in there to work, or another alternative one. Thanks, Matthew.

[dpdk-dev] "FATAL: Module uio not found" for dpdk usage on Amazon AWS

2015-03-18 Thread Matthew Hall
On Wed, Mar 18, 2015 at 06:41:05PM +, Naveen Gamini wrote: > When I tried to install dpdk on Amazon AWS ubuntu based linux, I see uio > module error. Can anyone help me to how to load uio module on ubuntu linux > so that IGB UIO module. Amazon Cloud Images usually include minimized kernel pa

[dpdk-dev] Packet data out of bounds after rte_eth_rx_burst

2015-03-23 Thread Matthew Hall
On Mon, Mar 23, 2015 at 05:19:00PM +0200, Dor Green wrote: > I changed it to free and it still happens. Note that the segmentation fault > happens before that anyway. > > I am using 1.7.1 at the moment. I can try using a newer version. I'm using 1.7.X in my open-source DPDK-based app and it works

[dpdk-dev] Symmetric RSS Hashing, Part 2

2015-03-23 Thread Matthew Hall
On Mon, Mar 23, 2015 at 04:20:33PM +0100, Thomas Monjalon wrote: > 2015-03-23 10:05, Matt Laswell: > > Hey Folks, > > > > I have essentially the same question as Matthew. Has there been progress > > in this area? > > No, AFAIK. > Submitting a patch would be a good start I think. Hi Thomas, We

[dpdk-dev] tools brainstorming

2015-03-23 Thread Matthew Hall
On Mon, Mar 23, 2015 at 05:18:49PM +0100, Thomas Monjalon wrote: > Don't you think adding a bug tracker would artificially split discussions > between mailing list threads and bug tracker entries? It is difficult to track the workflow around bugs without some kind of bug-friendly workflow tool.

[dpdk-dev] Symmetric RSS Hashing, Part 2

2015-03-27 Thread Matthew Hall
On Mar 26, 2015, at 10:30 PM, Zhang, Helin wrote: > Hi guys > > Did you guys talk about symmetric hash in software or in hardware? > > If about hardware, I have one comment. > I40e supports symmetric hash by hardware, which was enabled in i40e PMD > recently. You can have a try. > > Regards, >

[dpdk-dev] [RFC PATCH] eal: rte_rand yields only 62 random bits

2015-03-27 Thread Matthew Hall
On Fri, Mar 27, 2015 at 05:03:02PM -0700, Stephen Hemminger wrote: > I would argue remove rte_rand from DPDK. +1 To paraphrase Donald Knuth, "Random numbers should not be generated [using a function coded] at random." It'd be better to fix libc, or considering that has a slow dev cycle and pla

[dpdk-dev] Symmetric RSS Hashing, Part 2

2015-03-28 Thread Matthew Hall
On Sat, Mar 28, 2015 at 12:10:20PM +0300, Vladimir Medvedkin wrote: > I just verify RSS symmetric in my code, all works great. > ... > By the way, maybe it will be usefull to add softrss function in DPDK? Vladimir, All of this is super-awesome code. I agree having SW RSS would be quite nice. The

[dpdk-dev] GitHub sandbox for the DPDK community

2015-05-01 Thread Matthew Hall
On Fri, May 01, 2015 at 12:45:12PM -0400, Neil Horman wrote: > Yes, but as you said above, using a web browser doesn't make reviewing patches > faster. In fact, I would assert that it slows the process down, as it > prevents > quick, easy command line access to patch review (as you have with a pr

[dpdk-dev] GitHub sandbox for the DPDK community

2015-05-01 Thread Matthew Hall
On Fri, May 01, 2015 at 11:09:14AM -0700, Stephen Hemminger wrote: > With email, the patches are right in front of developers and easier to quote > for review comments. Right in front of that subset of developers who do everything kernel-style, perhaps yes. But this sort of workflow is in the min

[dpdk-dev] GitHub sandbox for the DPDK community

2015-05-01 Thread Matthew Hall
On Fri, May 01, 2015 at 10:59:32PM +0300, Aaro Koskinen wrote: > Projects like GCC, GLIBC, binutils, busybox, etc or what? > > A. You'll notice all of these are low-level UNIX hacker sorts of tools mostly, with the partial exception of busybox. But even that is mainly for embedded use. It doesn

[dpdk-dev] GitHub sandbox for the DPDK community

2015-05-04 Thread Matthew Hall
On Mon, May 04, 2015 at 12:43:48PM +, Qiu, Michael wrote: > What mail client do you use? I think mail client supporting thread mode > is important for patch review. Like many UNIX people, I use mutt. My concern is that, if we're making the widespread adoption, usage, and contributions for D

[dpdk-dev] one worker reading multiple ports

2014-11-20 Thread Matthew Hall
On Thu, Nov 20, 2014 at 05:10:51PM +0100, Newman Poborsky wrote: > Thank you for your answer. > > I just realized that the reason the rte_eth_rx_burst() returns 0 is because > inside ixgbe_recv_pkts() this fails: > nmb = rte_rxmbuf_alloc(rxq->mb_pool); => nmb is NULL > > Does this mean that ever

[dpdk-dev] [PATCH] Fix linking errors when CONFIG_RTE_BUILD_SHARED_LIB is enabled

2014-10-01 Thread Matthew Hall
On Thu, Oct 02, 2014 at 10:43:52AM +0900, Tetsuya Mukawa wrote: > I haven't known the options. Thanks. > Anyway, I understand I shouldn't change link order, but should check why > '--start-group/--end-group' doesn't work on my environment. > I will describe more in the email for Thomas. > > Regard

[dpdk-dev] [PATCH 2/4] Do not generate individual libs when configured with RTE_BUILD_COMBINE_LIBS=y

2014-10-02 Thread Matthew Hall
On Thu, Oct 02, 2014 at 04:56:24PM +0100, Sergio Gonzalez Monroy wrote: > When RTE_BUILD_COMBINE_LIBS=y is configured, there won't be individual shared > libraries to copy over. As a user of RTE_BUILD_COMBINE_LIBS, disabling the ability to use the individual libs after the option is enabled is no

[dpdk-dev] [PATCH 0/4] Fix build issues with CONFIG_RTE_BUILD_COMBINE_LIBS=y

2014-10-02 Thread Matthew Hall
On Thu, Oct 02, 2014 at 01:26:34PM -0400, Neil Horman wrote: > Just out of curiosity, whats the impetus behind a single shared library here? > Is it just to ease application linking operations? If so, it almost seems to > me > that we should abandon the individual linking method and just use this

[dpdk-dev] [PATCH 0/4] Fix build issues with CONFIG_RTE_BUILD_COMBINE_LIBS=y

2014-10-02 Thread Matthew Hall
On Thu, Oct 02, 2014 at 04:24:51PM -0400, Neil Horman wrote: > This seems somewhat irrelevant to the patch. The default configuration is > already the way you want it to be, shared library performance is actually very > close to static performance, and yes, people can choose how they want to > bu

[dpdk-dev] [PATCH 0/4] Fix build issues with CONFIG_RTE_BUILD_COMBINE_LIBS=y

2014-10-03 Thread Matthew Hall
On Fri, Oct 03, 2014 at 09:15:20AM +0200, Thomas Monjalon wrote: > We need to simplify build options. So I'm fine to remove COMBINE_LIBS option > to always enable it. > About making only one single static library, I think it's a good idea if > it brings a real code simplification. > > So the concl

[dpdk-dev] [PATCH 0/4] Fix build issues with CONFIG_RTE_BUILD_COMBINE_LIBS=y

2014-10-03 Thread Matthew Hall
On Fri, Oct 03, 2014 at 10:27:30AM +0200, Thomas Monjalon wrote: > The proposal is to always build single (combined) lib AND to build separated > libs in case of shared libraries. > For static library: only one single (combined) static library. In the static case, this won't be backward compatible

[dpdk-dev] [PATCH 0/4] Fix build issues with CONFIG_RTE_BUILD_COMBINE_LIBS=y

2014-10-03 Thread Matthew Hall
On Fri, Oct 03, 2014 at 07:32:34AM -0400, Neil Horman wrote: > This makes good sense to me. A single archive is just easier in the static > case, since the resulting binary will strip out unused code anyway, and > multiple > libraries are needed in the shared case so that we don't wind up havin

[dpdk-dev] [PATCH 0/4] Fix build issues with CONFIG_RTE_BUILD_COMBINE_LIBS=y

2014-10-03 Thread Matthew Hall
On Fri, Oct 03, 2014 at 03:15:46PM -0400, Neil Horman wrote: > With a single archive, you get everything you build even if you don't need > it. Right, I was trying to avoid that for people who specifically didn't want it, if there are any... I'm not one of them. > But presumably if you're build

[dpdk-dev] Possible bug in eal_pci pci_scan_one

2014-10-06 Thread Matthew Hall
Hi Guys, I'm doing my development on kind of a cheap machine with no NUMA support... but several years ago I used DPDK to build a NUMA box that could do 40 gbits bidirectional L4-L7 stateful traffic replay. So given the past experiences I had before, I wanted to clean the code up so it'd work

[dpdk-dev] [PATCH v2 3/4] Update library build process

2014-10-06 Thread Matthew Hall
On Mon, Oct 06, 2014 at 11:52:34AM +0100, Sergio Gonzalez Monroy wrote: > Remove COMBINE_LIBS option and by default build: > - CONFIG_RTE_BUILD_SHARED_LIB=y : both individual and combined libraries > - CONFIG_RTE_BUILD_SHARED_LIB=n : single combined library As previously discussed.,It would be bet

[dpdk-dev] [PATCH v2 3/4] Update library build process

2014-10-08 Thread Matthew Hall
On Tue, Oct 07, 2014 at 10:55:11AM +0100, Sergio Gonzalez Monroy wrote: > I don't see how this particular patch would force people to change their code, > though in all likelihood they will have to as a result of ABI changes in the > following release. > > The only difference now would be when they

[dpdk-dev] [PATCH RFC] librte_reorder: new reorder library

2014-10-08 Thread Matthew Hall
On Tue, Oct 07, 2014 at 09:33:06AM +, Pattan, Reshma wrote: > To be used along with distributor library. Next version of distributor are > planned to distribute incoming packets to all worker cores irrespective of > the flow type. In this case to ensure in order delivery of the packets at >

[dpdk-dev] [PATCH RFC] librte_reorder: new reorder library

2014-10-08 Thread Matthew Hall
On Wed, Oct 08, 2014 at 06:55:41PM -0400, Neil Horman wrote: > I think because there is a possibility that multiple workers may be used for > a > single tx queue. > > Neil OK, so, in my application packets are RX'ed to a predictable RX queue and core using RSS. Then you put them into a predic

[dpdk-dev] [PATCH] llib/ibrte_net: workaround to avoid macro conflict

2014-10-08 Thread Matthew Hall
If the DPDK wants to conflict with all those system headers it means they also have to provide working replacement for inet_pton, inet_ntop, and every other important socket function which depends upon in.h or depends upon code depending upon in.h. Clearly this doesn't represent a sustainable pa

[dpdk-dev] [PATCH RFC] librte_reorder: new reorder library

2014-10-09 Thread Matthew Hall
On Thu, Oct 09, 2014 at 10:14:21AM +0100, Bruce Richardson wrote: > Hi Matthew, > > What you are doing will indeed work, and it's the way the vast majority of > the sample apps are written. However, this will not always work for everyone > else, sadly. > > First off, with RSS, there are a numbe

[dpdk-dev] [PATCH RFC] librte_reorder: new reorder library

2014-10-09 Thread Matthew Hall
On Thu, Oct 09, 2014 at 12:09:42PM -0400, Neil Horman wrote: > From what you've said above, sequence assignment needs to occur prior to any > order breaking event. That means you either need to do it in individual PMD's > on RX, or in the rte_eth library if you want to make it common. On the TX

[dpdk-dev] DPDK - VIRTIO performance problems

2014-10-12 Thread Matthew Hall
On Sun, Oct 12, 2014 at 12:37:37PM +, Yan Freedland wrote: > Every ~2min traffic stopped completely and then immediately came back. This > happened in a periodic fashion. To me it sounds like it could be similar to what I've seen when I ran out of mbuf's or ran out of RX / TX descriptor entr

[dpdk-dev] virtio UIO / PMD issues in default Ubuntu Cloud Images

2014-10-13 Thread Matthew Hall
Hello, I was working to get my open source project running in a VirtualBox Vagrant VM powered by an Ubuntu Cloud image the last few days to make my project and DPDK more developer friendly with a prebuilt environment. During this I was fixing the ugly hardcodings I'd used to hack it together on

[dpdk-dev] Possible bug in eal_pci pci_scan_one

2014-10-13 Thread Matthew Hall
iably init on single socket, dual socket non-NUMA, and dual socket NUMA boxes. Thanks, Matthew. On Mon, Oct 06, 2014 at 02:13:44AM -0700, Matthew Hall wrote: > Hi Guys, > > I'm doing my development on kind of a cheap machine with no NUMA support... > but several years ago I us

[dpdk-dev] virtio UIO / PMD issues in default Ubuntu Cloud Images

2014-10-13 Thread Matthew Hall
n/ld: test: hidden symbol `mknod' in /usr/lib/x86_64-linux-gnu/libc_nonshared.a(mknod.oS) is referenced by DSO /usr/bin/ld: final link failed: Bad value Did anybody ever see something this before? Thanks, Matthew. On Mon, Oct 13, 2014 at 10:45:23PM -0700, Matthew Hall wrote: > Hello, >

[dpdk-dev] virtio UIO / PMD issues in default Ubuntu Cloud Images

2014-10-13 Thread Matthew Hall
On Mon, Oct 13, 2014 at 11:03:53PM -0700, Matthew Hall wrote: > Another weird issue... when I tried to compile a DPDK shared lib using clang > I > got this really, really weird error: > > /usr/bin/ld: test: hidden symbol `mknod' in > /usr/lib/x86_64-linux-gnu/libc_n

[dpdk-dev] virtio UIO / PMD issues in default Ubuntu Cloud Images

2014-10-13 Thread Matthew Hall
On Mon, Oct 13, 2014 at 11:03:53PM -0700, Matthew Hall wrote: > Another problem regarding virtio-net-pmd. When I tried using virtio-net-pmd, > it compiles fine but then hits a weird error also during EAL init process: > > EAL: open shared lib /vagrant/external/virtio-net-pmd/librte_p

[dpdk-dev] Alternatives to RSS on virtio-net devices

2014-10-14 Thread Matthew Hall
Hello, Having worked around the previously reported bizarre linker issues, I can now see this new error: PMD: virtio_dev_start(): RSS cannot be configured for VirtI/O net devices If I want to ensure that the flows are sent consistently to the same core on virtio-net to prevent surprises, what

[dpdk-dev] [PATCH] virtio-net-pmd: .gitignore: ignore librte_pmd_virtio.so

2014-10-14 Thread Matthew Hall
Signed-off-by: Matthew Hall --- .gitignore | 1 + 1 file changed, 1 insertion(+) diff --git a/.gitignore b/.gitignore index e69de29..08d831a 100644 --- a/.gitignore +++ b/.gitignore @@ -0,0 +1 @@ +librte_pmd_virtio.so -- 1.9.1

[dpdk-dev] virtio UIO / PMD issues in default Ubuntu Cloud Images

2014-10-14 Thread Matthew Hall
ll to work right. Matthew. -- Sent from my mobile device. On October 14, 2014 1:22:56 AM PDT, "Gonzalez Monroy, Sergio" wrote: > > >> -Original Message- >> From: dev [mailto:dev-bounces at dpdk.org] On Behalf Of Matthew Hall >> Sent: Tuesday, October 14, 20

[dpdk-dev] [PATCH] virtio-net-pmd: .gitignore: ignore librte_pmd_virtio.so

2014-10-14 Thread Matthew Hall
Richardson wrote: >On Tue, Oct 14, 2014 at 07:53:56AM +0000, Matthew Hall wrote: >> Signed-off-by: Matthew Hall >> --- >> .gitignore | 1 + >> 1 file changed, 1 insertion(+) >> >> diff --git a/.gitignore b/.gitignore >> index e69de29..08d831a 1

[dpdk-dev] [PATCH] virtio-net-pmd: .gitignore: ignore librte_pmd_virtio.so

2014-10-14 Thread Matthew Hall
100 >Bruce Richardson wrote: > >> On Tue, Oct 14, 2014 at 07:53:56AM +0000, Matthew Hall wrote: >> > Signed-off-by: Matthew Hall >> > --- >> > .gitignore | 1 + >> > 1 file changed, 1 insertion(+) >> > >> > diff --git a/

[dpdk-dev] [PATCH] virtio-net-pmd: .gitignore: ignore librte_pmd_virtio.so

2014-10-14 Thread Matthew Hall
In the virtio-net-pmd it is done in the same directory. Hence me submitting this to try to make it easier for others to use the product. Also the default DPDK doesn't ignore the build target directories... but I already had to fork that one to fix clang compile failures in the examples files.

[dpdk-dev] to the intel dpdk engineers and all contributors

2014-10-15 Thread Matthew Hall
On Wed, Oct 15, 2014 at 04:46:41PM -0400, daniel chapiesky wrote: > At time 4:30, he mentioned the "shock to the system" of developers > expecting a pat on the back and instead receiving critiques of their > code. > > I realized that I was one of those who failed to acknowledge the incredible

[dpdk-dev] virtio UIO / PMD issues in default Ubuntu Cloud Images

2014-10-17 Thread Matthew Hall
Hi Sergio, Sorry for the delay, this project is part-time. On Tue, Oct 14, 2014 at 12:16:07PM +, Gonzalez Monroy, Sergio wrote: > Could you provide steps to reproduce your issue with virtio non-UIO PMD > (virtio-net-pmd) using static combined DPDK lib? I am getting two different kinds of pr

[dpdk-dev] [PATCH RFC] librte_reorder: new reorder library

2014-10-18 Thread Matthew Hall
On Fri, Oct 17, 2014 at 09:44:49AM +, Pattan, Reshma wrote: > [Reshma]: Library just takes care of packets what it has got. No waiting > mechanism is used for missing packets. > [Reshma]: This is dependent upon how frequently packets are enqueued and > dequeued from it. Packets which are in

[dpdk-dev] IPC/message passing between DPDK application and non-DPDK userspace application

2014-10-18 Thread Matthew Hall
On Fri, Oct 17, 2014 at 10:14:50PM -0400, Kamraan Nasim wrote: > I have a DPI daemon running in userspace which uses libpcap for packet RX > that I would like to replace with DPDK ethernet PMD. However it is not > feasible to convert the entire application to run within the DPDK framework > which i

[dpdk-dev] "TX WTHRESH must be set to 0 if tx_rs_thresh is greater than 1"

2014-10-18 Thread Matthew Hall
Hello, I'm just trying to understand what you're supposed to do about this error to get the optiomal configuration / performance. The error message and comments seem like they're designed for Intel ethernet driver hackers not security hackers like myself! ;-) Note: I'm trying out the Intel 825

[dpdk-dev] "TX WTHRESH must be set to 0 if tx_rs_thresh is greater than 1"

2014-10-19 Thread Matthew Hall
1.7.1 with a few minor clang compatibility patches in the example apps -- Sent from my mobile device. On October 19, 2014 6:46:27 AM PDT, Marc Sune wrote: >Which DPDK version are you using > >marc > >On 19/10/14 00:50, Matthew Hall wrote: >> Hello, >> >> I

[dpdk-dev] "TX WTHRESH must be set to 0 if tx_rs_thresh is greater than 1"

2014-10-20 Thread Matthew Hall
On Mon, Oct 20, 2014 at 10:36:01AM +0100, Bruce Richardson wrote: > On Sun, Oct 19, 2014 at 10:08:29AM -0700, Matthew Hall wrote: > > 1.7.1 with a few minor clang compatibility patches in the example apps > > Rather than trying to tune the results yourself, maybe you could look to

[dpdk-dev] development/integration branch?

2014-10-22 Thread Matthew Hall
On Tue, Oct 21, 2014 at 11:28:47AM +0200, Thomas Monjalon wrote: > But I care about the message brought by such change. It would mean that > we can break the development branch and that most of developers don't test > it nor base their patches on the latest commit. It's all about simple rules > and

[dpdk-dev] virtio UIO / PMD issues in default Ubuntu Cloud Images

2014-10-22 Thread Matthew Hall
On Tue, Oct 21, 2014 at 01:22:27PM +, Gonzalez Monroy, Sergio wrote: > As you point out below, when building static DPDK we should not expect ldd > to report any DPDK dependency. When building shared DPDK libs, we should > expect such dependency expect for the fact that we are not linking aga

[dpdk-dev] development/integration branch?

2014-10-22 Thread Matthew Hall
:36 AM PDT, Stephen Hemminger wrote: >On Wed, 22 Oct 2014 00:00:58 -0700 >Matthew Hall wrote: > >> What I think git in general and DPDK in particular are missing is, >they have a >> tradition tags for releases, however I think this is broken because >you can't >> e

[dpdk-dev] virtio UIO / PMD issues in default Ubuntu Cloud Images

2014-10-22 Thread Matthew Hall
On Wed, Oct 22, 2014 at 03:20:40PM +, Gonzalez Monroy, Sergio wrote: > You are not forced to use shared libraries. This module loads successfully > with an app (testpmd) built against static DPDK libs. It sounds like it just requires additional options as mentioned later in your mail. We sho

[dpdk-dev] [dpdk-announce] DPDK Features for Q1 2015

2014-10-22 Thread Matthew Hall
On Wed, Oct 22, 2014 at 01:48:36PM +, O'driscoll, Tim wrote: > Single Virtio Driver: Merge existing Virtio drivers into a single > implementation, incorporating the best features from each of the existing > drivers. Tim, There is a lot of good stuff in there. Specifically, in the virtio-ne

<    1   2   3   4   >