This repository was archived by the owner on Apr 1, 2023. It is now read-only.

Af xdp multi threading#5

Draft

zzxgzgz wants to merge 35 commits intofuturewei-cloud:mainfrom

zzxgzgz:af_xdp_multi_threading

Commits on Oct 4, 2022

Initial commit that includes changes in the libbpf installation
zzxgzgz
committed

Commits on Oct 7, 2022

Commits on Oct 11, 2022

Included glog install in the machine-init.sh
zzxgzgz
committed

Commits on Oct 12, 2022

Added code to parse packet headers all the way to inner IP
zzxgzgz
committed

Commits on Oct 27, 2022

Check in code, right now the af_xdp_user is able to get packets from socket, and able to parse packet until the ARP level
zzxgzgz
committed

Commits on Nov 10, 2022

Commits on Nov 14, 2022

This commit enables the happy path for pinging; ARP request/reply is successful
zzxgzgz
committed

Commits on Nov 18, 2022

AF_XDP working for ARP and IP
zzxgzgz
committed

Commits on Nov 29, 2022

Refactored db_client to make local_db accessible by other files; implemented endpoint cache layer for better lookup performance; refactored functions in af_xdp_user to utils
zzxgzgz
committed

Commits on Nov 30, 2022

added counter to count processed packets; changed return type of GetNeighborInMemory from pointer to value, in order to make the packet correct after modification
zzxgzgz
committed

Commits on Dec 6, 2022

Changed folly::ConcurrentHashMap to std::unordered_map for better performance
zzxgzgz
committed

Commits on Dec 21, 2022

With this commit, AF_XDP multi threading works for ping with 8 threads; need to investigate how to add use round robin in kernel, how to make iperf work and how to user more threads
zzxgzgz
committed

Commits on Dec 28, 2022

bcache_cons_check has a bug where the first n_buffer_cons is zero, even after trading from bpool. Made a hack to make iperf work.
zzxgzgz
committed

Commits on Dec 30, 2022

With this commit, AF_XDP with 8 sockets works for multipe iperfs, but it still stops receiving traffic from time to time
zzxgzgz
committed

Commits on Dec 31, 2022

Fixed the cached drained problem, by setting the UMEM Fill Queue and Completion Queue to have the same size
zzxgzgz
committed

Commits on Jan 14, 2023

Added logic to save 8 cores for the machine and use the rest for AF_XDP sockets.
zzxgzgz
committed

Commits on Jan 19, 2023

Added data models for security group and connection tracking; added ebpf map fd for security group ebpf table; added sample code to insert data into security group ebpf maps
zzxgzgz
committed

Commits on Jan 21, 2023

Modified the sg_cidr_key_t, added remote_ip field
zzxgzgz
committed

Commits on Jan 23, 2023

Added security group rule to the local DB and to the gRPC client.
zzxgzgz
committed

Commits on Jan 24, 2023

Added support for adding security group port binding to grpc client; need to be tested
zzxgzgz
committed

Commits on Jan 25, 2023

Moved sync_schema() to the right place; fixed creation of the LPM Trie ebpf map
zzxgzgz
committed

Commits on Jan 28, 2023

Commits on Feb 1, 2023

Updated sg rule schema
zzxgzgz
committed