From patchwork Wed Aug 14 21:36:45 2019 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: "Jose E. Marchesi" X-Patchwork-Id: 1147729 Return-Path: X-Original-To: incoming@patchwork.ozlabs.org Delivered-To: patchwork-incoming@bilbo.ozlabs.org Authentication-Results: ozlabs.org; spf=pass (mailfrom) smtp.mailfrom=gcc.gnu.org (client-ip=209.132.180.131; helo=sourceware.org; envelope-from=gcc-patches-return-507078-incoming=patchwork.ozlabs.org@gcc.gnu.org; receiver=) Authentication-Results: ozlabs.org; dmarc=fail (p=none dis=none) header.from=oracle.com Authentication-Results: ozlabs.org; dkim=pass (1024-bit key; unprotected) header.d=gcc.gnu.org header.i=@gcc.gnu.org header.b="br8nwWi5"; dkim-atps=neutral Received: from sourceware.org (server1.sourceware.org [209.132.180.131]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ozlabs.org (Postfix) with ESMTPS id 468Ygr54NKz9sN1 for ; Fri, 16 Aug 2019 03:42:46 +1000 (AEST) DomainKey-Signature: a=rsa-sha1; c=nofws; d=gcc.gnu.org; h=list-id :list-unsubscribe:list-archive:list-post:list-help:sender:from :to:date:message-id:in-reply-to:references:subject; q=dns; s= default; b=JMooa40yG+h475NJepBjY2KoxnXiv5gZBaokCLcUmhmmxijOY9FnU N0/zLWkwahe3Xwj1NK2qIxavcJjtNooqKSQNk1um51XWZZ0ojp241piAdEg/kuxT NZ5wscTV3R0+6NRbbM6lDvqDvuydOxgqJCZ6KJJbYTR2ZIRF8eCbCs= DKIM-Signature: v=1; a=rsa-sha1; c=relaxed; d=gcc.gnu.org; h=list-id :list-unsubscribe:list-archive:list-post:list-help:sender:from :to:date:message-id:in-reply-to:references:subject; s=default; bh=Xz8kvkJrG0mCu1QXDpHYLMHn69g=; b=br8nwWi5UZZalYXNTMPH74dKzA1v cH1sANwcDP70JDviZClL1BRoTMUetUp0mnVpMcCT0qJnp+qXCWcrV+8TVoDEPw6C 0a+G13Jx7WBd5rMCCv+UhwBMYPBfXcsXfPizINdcxhFguBqd8MA3etp5eaNS0ud9 mMsD10RJSzrfc/w= Received: (qmail 8491 invoked by alias); 15 Aug 2019 17:42:15 -0000 Mailing-List: contact gcc-patches-help@gcc.gnu.org; run by ezmlm Precedence: bulk List-Id: List-Unsubscribe: List-Archive: List-Post: List-Help: Sender: gcc-patches-owner@gcc.gnu.org Delivered-To: mailing list gcc-patches@gcc.gnu.org Received: (qmail 8399 invoked by uid 89); 15 Aug 2019 17:42:14 -0000 Authentication-Results: sourceware.org; auth=none X-Spam-SWARE-Status: No, score=-21.1 required=5.0 tests=AWL, BAYES_00, GIT_PATCH_0, GIT_PATCH_1, GIT_PATCH_2, GIT_PATCH_3, KAM_SHORT, UNPARSEABLE_RELAY autolearn=ham version=3.3.1 spammy= X-HELO: aserp2110.oracle.com Received: from aserp2110.oracle.com (HELO aserp2110.oracle.com) (141.146.126.77) by sourceware.org (qpsmtpd/0.93/v0.84-503-g423c35a) with ESMTP; Thu, 15 Aug 2019 17:41:57 +0000 Received: from pps.filterd (aserp2110.oracle.com [127.0.0.1]) by aserp2110.oracle.com (8.16.0.27/8.16.0.27) with SMTP id x7FHfrmT079416 for ; Thu, 15 Aug 2019 17:41:53 GMT Received: from pps.reinject (localhost [127.0.0.1]) by aserp2110.oracle.com with ESMTP id 2u9p1tr1er-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK) for ; Thu, 15 Aug 2019 17:41:53 +0000 Received: from pps.reinject (aserp2110.oracle.com [127.0.0.1]) by pps.reinject (8.16.0.27/8.16.0.27) with SMTP id x7FHfqct079402 for ; Thu, 15 Aug 2019 17:41:52 GMT Received: from aserp3010.oracle.com (aserp3010.oracle.com [141.146.126.69]) by userp2130.oracle.com with ESMTP id 2u9nbtv327-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK) for ; Thu, 15 Aug 2019 17:40:53 +0000 Received: from pps.filterd (aserp3010.oracle.com [127.0.0.1]) by aserp3010.oracle.com (8.16.0.27/8.16.0.27) with SMTP id x7FHermd140225 for ; Thu, 15 Aug 2019 17:40:53 GMT Received: from pps.reinject (localhost [127.0.0.1]) by aserp3010.oracle.com with ESMTP id 2ub9kv00rj-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Thu, 15 Aug 2019 17:40:53 +0000 Received: from pps.reinject (aserp3010.oracle.com [127.0.0.1]) by pps.reinject (8.16.0.27/8.16.0.27) with SMTP id x7FHequS140215 for ; Thu, 15 Aug 2019 17:40:52 GMT Received: from userv0122.oracle.com (userv0122.oracle.com [156.151.31.75]) by userp3030.oracle.com with ESMTP id 2ucmwhx5mc-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK) for ; Wed, 14 Aug 2019 21:37:02 +0000 Received: from abhmp0011.oracle.com (abhmp0011.oracle.com [141.146.116.17]) by userv0122.oracle.com (8.14.4/8.14.4) with ESMTP id x7ELb1mt026224 for ; Wed, 14 Aug 2019 21:37:01 GMT Received: from termi.localdomain (/10.175.39.187) by default (Oracle Beehive Gateway v4.0) with ESMTP ; Wed, 14 Aug 2019 14:36:59 -0700 From: "Jose E. Marchesi" To: gcc-patches@gcc.gnu.org Date: Wed, 14 Aug 2019 23:36:45 +0200 Message-Id: <20190814213651.20286-3-jose.marchesi@oracle.com> In-Reply-To: <20190814213651.20286-1-jose.marchesi@oracle.com> References: <20190814213651.20286-1-jose.marchesi@oracle.com> subject: [PATCH 2/8] bpf: new GCC port X-IsSubscribed: yes This patch adds a port for the Linux kernel eBPF architecture to GCC. ChangeLog: * configure.ac: Support for bpf-*-* targets. * configure: Regenerate. contrib/ChangeLog: * config-list.mk (LIST): Disable go in bpf-*-* targets. gcc/ChangeLog: * config.gcc: Support for bpf-*-* targets. * common/config/bpf/bpf-common.c: New file. * config/bpf/t-bpf: Likewise. * config/bpf/predicates.md: Likewise. * config/bpf/constraints.md: Likewise. * config/bpf/bpf.opt: Likewise. * config/bpf/bpf.md: Likewise. * config/bpf/bpf.h: Likewise. * config/bpf/bpf.c: Likewise. * config/bpf/bpf-protos.h: Likewise. * config/bpf/bpf-opts.h: Likewise. * config/bpf/bpf-helpers.h: Likewise. * config/bpf/bpf-helpers.def: Likewise. --- ChangeLog | 5 + configure | 68 ++- configure.ac | 54 +- contrib/ChangeLog | 4 + contrib/config-list.mk | 2 +- gcc/ChangeLog | 16 + gcc/common/config/bpf/bpf-common.c | 57 ++ gcc/config.gcc | 9 + gcc/config/bpf/bpf-helpers.def | 194 ++++++ gcc/config/bpf/bpf-helpers.h | 324 ++++++++++ gcc/config/bpf/bpf-opts.h | 56 ++ gcc/config/bpf/bpf-protos.h | 33 ++ gcc/config/bpf/bpf.c | 1136 ++++++++++++++++++++++++++++++++++++ gcc/config/bpf/bpf.h | 565 ++++++++++++++++++ gcc/config/bpf/bpf.md | 528 +++++++++++++++++ gcc/config/bpf/bpf.opt | 119 ++++ gcc/config/bpf/constraints.md | 29 + gcc/config/bpf/predicates.md | 105 ++++ gcc/config/bpf/t-bpf | 0 19 files changed, 3300 insertions(+), 4 deletions(-) create mode 100644 gcc/common/config/bpf/bpf-common.c create mode 100644 gcc/config/bpf/bpf-helpers.def create mode 100644 gcc/config/bpf/bpf-helpers.h create mode 100644 gcc/config/bpf/bpf-opts.h create mode 100644 gcc/config/bpf/bpf-protos.h create mode 100644 gcc/config/bpf/bpf.c create mode 100644 gcc/config/bpf/bpf.h create mode 100644 gcc/config/bpf/bpf.md create mode 100644 gcc/config/bpf/bpf.opt create mode 100644 gcc/config/bpf/constraints.md create mode 100644 gcc/config/bpf/predicates.md create mode 100644 gcc/config/bpf/t-bpf diff --git a/configure b/configure index 63b1e33f41c..4f8e68a4085 100755 --- a/configure +++ b/configure @@ -754,6 +754,7 @@ infodir docdir oldincludedir includedir +runstatedir localstatedir sharedstatedir sysconfdir @@ -919,6 +920,7 @@ datadir='${datarootdir}' sysconfdir='${prefix}/etc' sharedstatedir='${prefix}/com' localstatedir='${prefix}/var' +runstatedir='${localstatedir}/run' includedir='${prefix}/include' oldincludedir='/usr/include' docdir='${datarootdir}/doc/${PACKAGE}' @@ -1171,6 +1173,15 @@ do | -silent | --silent | --silen | --sile | --sil) silent=yes ;; + -runstatedir | --runstatedir | --runstatedi | --runstated \ + | --runstate | --runstat | --runsta | --runst | --runs \ + | --run | --ru | --r) + ac_prev=runstatedir ;; + -runstatedir=* | --runstatedir=* | --runstatedi=* | --runstated=* \ + | --runstate=* | --runstat=* | --runsta=* | --runst=* | --runs=* \ + | --run=* | --ru=* | --r=*) + runstatedir=$ac_optarg ;; + -sbindir | --sbindir | --sbindi | --sbind | --sbin | --sbi | --sb) ac_prev=sbindir ;; -sbindir=* | --sbindir=* | --sbindi=* | --sbind=* | --sbin=* \ @@ -1308,7 +1319,7 @@ fi for ac_var in exec_prefix prefix bindir sbindir libexecdir datarootdir \ datadir sysconfdir sharedstatedir localstatedir includedir \ oldincludedir docdir infodir htmldir dvidir pdfdir psdir \ - libdir localedir mandir + libdir localedir mandir runstatedir do eval ac_val=\$$ac_var # Remove trailing slashes. @@ -1468,6 +1479,7 @@ Fine tuning of the installation directories: --sysconfdir=DIR read-only single-machine data [PREFIX/etc] --sharedstatedir=DIR modifiable architecture-independent data [PREFIX/com] --localstatedir=DIR modifiable single-machine data [PREFIX/var] + --runstatedir=DIR modifiable per-process data [LOCALSTATEDIR/run] --libdir=DIR object code libraries [EPREFIX/lib] --includedir=DIR C header files [PREFIX/include] --oldincludedir=DIR C header files for non-gcc [/usr/include] @@ -3353,6 +3365,9 @@ case "${target}" in # No hosted I/O support. noconfigdirs="$noconfigdirs target-libssp" ;; + bpf-*-*) + noconfigdirs="$noconfigdirs target-libssp" + ;; powerpc-*-aix* | rs6000-*-aix*) noconfigdirs="$noconfigdirs target-libssp" ;; @@ -3387,12 +3402,43 @@ if test "${ENABLE_LIBSTDCXX}" = "default" ; then avr-*-*) noconfigdirs="$noconfigdirs target-libstdc++-v3" ;; + bpf-*-*) + noconfigdirs="$noconfigdirs target-libstdc++-v3" + ;; ft32-*-*) noconfigdirs="$noconfigdirs target-libstdc++-v3" ;; esac fi +# Disable C++ on systems where it is known to not work. +# For testing, you can override this with --enable-languages=c++. +case ,${enable_languages}, in + *,c++,*) + ;; + *) + case "${target}" in + bpf-*-*) + unsupported_languages="$unsupported_languages c++" + ;; + esac + ;; +esac + +# Disable Objc on systems where it is known to not work. +# For testing, you can override this with --enable-languages=objc. +case ,${enable_languages}, in + *,objc,*) + ;; + *) + case "${target}" in + bpf-*-*) + unsupported_languages="$unsupported_languages objc" + ;; + esac + ;; +esac + # Disable D on systems where it is known to not work. # For testing, you can override this with --enable-languages=d. case ,${enable_languages}, in @@ -3402,6 +3448,9 @@ case ,${enable_languages}, in case "${target}" in *-*-darwin*) unsupported_languages="$unsupported_languages d" + ;; + bpf-*-*) + unsupported_languages="$unsupported_languages d" ;; esac ;; @@ -3433,6 +3482,9 @@ case "${target}" in # See . unsupported_languages="$unsupported_languages fortran" ;; + bpf-*-*) + unsupported_languages="$unsupported_languages fortran" + ;; esac # Disable libffi for some systems. @@ -3479,6 +3531,9 @@ case "${target}" in arm*-*-symbianelf*) noconfigdirs="$noconfigdirs target-libffi" ;; + bpf-*-*) + noconfigdirs="$noconfigdirs target-libffi" + ;; cris-*-* | crisv32-*-*) case "${target}" in *-*-linux*) @@ -3525,7 +3580,7 @@ esac # Disable the go frontend on systems where it is known to not work. Please keep # this in sync with contrib/config-list.mk. case "${target}" in -*-*-darwin* | *-*-cygwin* | *-*-mingw*) +*-*-darwin* | *-*-cygwin* | *-*-mingw* | bpf-* ) unsupported_languages="$unsupported_languages go" ;; esac @@ -3541,6 +3596,9 @@ if test x$enable_libgo = x; then *-*-cygwin* | *-*-mingw*) noconfigdirs="$noconfigdirs target-libgo" ;; + bpf-*-*) + noconfigdirs="$noconfigdirs target-libgo" + ;; esac fi @@ -3612,6 +3670,9 @@ case "${target}" in sparc-*-sunos4*) noconfigdirs="$noconfigdirs target-newlib target-libgloss" ;; + bpf-*-*) + noconfigdirs="$noconfigdirs target-newlib target-libgloss" + ;; *-*-aix*) noconfigdirs="$noconfigdirs target-newlib target-libgloss" ;; @@ -3725,6 +3786,9 @@ case "${target}" in # newlib is not 64 bit ready noconfigdirs="$noconfigdirs target-newlib target-libgloss" ;; + bpf-*-*) + noconfigdirs="$noconfigdirs target-libobjc target-libbacktrace" + ;; sh*-*-pe|mips*-*-pe|*arm-wince-pe) noconfigdirs="$noconfigdirs tcl tk itcl libgui sim" ;; diff --git a/configure.ac b/configure.ac index dcc89fbdde1..b7ca25c04c1 100644 --- a/configure.ac +++ b/configure.ac @@ -638,6 +638,9 @@ case "${target}" in # No hosted I/O support. noconfigdirs="$noconfigdirs target-libssp" ;; + bpf-*-*) + noconfigdirs="$noconfigdirs target-libssp" + ;; powerpc-*-aix* | rs6000-*-aix*) noconfigdirs="$noconfigdirs target-libssp" ;; @@ -672,12 +675,43 @@ if test "${ENABLE_LIBSTDCXX}" = "default" ; then avr-*-*) noconfigdirs="$noconfigdirs target-libstdc++-v3" ;; + bpf-*-*) + noconfigdirs="$noconfigdirs target-libstdc++-v3" + ;; ft32-*-*) noconfigdirs="$noconfigdirs target-libstdc++-v3" ;; esac fi +# Disable C++ on systems where it is known to not work. +# For testing, you can override this with --enable-languages=c++. +case ,${enable_languages}, in + *,c++,*) + ;; + *) + case "${target}" in + bpf-*-*) + unsupported_languages="$unsupported_languages c++" + ;; + esac + ;; +esac + +# Disable Objc on systems where it is known to not work. +# For testing, you can override this with --enable-languages=objc. +case ,${enable_languages}, in + *,objc,*) + ;; + *) + case "${target}" in + bpf-*-*) + unsupported_languages="$unsupported_languages objc" + ;; + esac + ;; +esac + # Disable D on systems where it is known to not work. # For testing, you can override this with --enable-languages=d. case ,${enable_languages}, in @@ -687,6 +721,9 @@ case ,${enable_languages}, in case "${target}" in *-*-darwin*) unsupported_languages="$unsupported_languages d" + ;; + bpf-*-*) + unsupported_languages="$unsupported_languages d" ;; esac ;; @@ -715,6 +752,9 @@ case "${target}" in # See . unsupported_languages="$unsupported_languages fortran" ;; + bpf-*-*) + unsupported_languages="$unsupported_languages fortran" + ;; esac # Disable libffi for some systems. @@ -761,6 +801,9 @@ case "${target}" in arm*-*-symbianelf*) noconfigdirs="$noconfigdirs target-libffi" ;; + bpf-*-*) + noconfigdirs="$noconfigdirs target-libffi" + ;; cris-*-* | crisv32-*-*) case "${target}" in *-*-linux*) @@ -807,7 +850,7 @@ esac # Disable the go frontend on systems where it is known to not work. Please keep # this in sync with contrib/config-list.mk. case "${target}" in -*-*-darwin* | *-*-cygwin* | *-*-mingw*) +*-*-darwin* | *-*-cygwin* | *-*-mingw* | bpf-* ) unsupported_languages="$unsupported_languages go" ;; esac @@ -823,6 +866,9 @@ if test x$enable_libgo = x; then *-*-cygwin* | *-*-mingw*) noconfigdirs="$noconfigdirs target-libgo" ;; + bpf-*-*) + noconfigdirs="$noconfigdirs target-libgo" + ;; esac fi @@ -894,6 +940,9 @@ case "${target}" in sparc-*-sunos4*) noconfigdirs="$noconfigdirs target-newlib target-libgloss" ;; + bpf-*-*) + noconfigdirs="$noconfigdirs target-newlib target-libgloss" + ;; *-*-aix*) noconfigdirs="$noconfigdirs target-newlib target-libgloss" ;; @@ -1007,6 +1056,9 @@ case "${target}" in # newlib is not 64 bit ready noconfigdirs="$noconfigdirs target-newlib target-libgloss" ;; + bpf-*-*) + noconfigdirs="$noconfigdirs target-libobjc target-libbacktrace" + ;; sh*-*-pe|mips*-*-pe|*arm-wince-pe) noconfigdirs="$noconfigdirs tcl tk itcl libgui sim" ;; diff --git a/contrib/config-list.mk b/contrib/config-list.mk index 69c826e649a..aa9fdb64eaf 100644 --- a/contrib/config-list.mk +++ b/contrib/config-list.mk @@ -123,7 +123,7 @@ $(LIST): make-log-dir TGT=`echo $@ | awk 'BEGIN { FS = "OPT" }; { print $$1 }'` && \ TGT=`$(GCC_SRC_DIR)/config.sub $$TGT` && \ case $$TGT in \ - *-*-darwin* | *-*-cygwin* | *-*-mingw* | *-*-aix*) \ + *-*-darwin* | *-*-cygwin* | *-*-mingw* | *-*-aix* | bpf-*-* ) \ ADDITIONAL_LANGUAGES=""; \ ;; \ *) \ diff --git a/gcc/common/config/bpf/bpf-common.c b/gcc/common/config/bpf/bpf-common.c new file mode 100644 index 00000000000..a68feb62897 --- /dev/null +++ b/gcc/common/config/bpf/bpf-common.c @@ -0,0 +1,57 @@ +/* Common hooks for eBPF. + Copyright (C) 2019 Free Software Foundation, Inc. + +This file is part of GCC. + +GCC is free software; you can redistribute it and/or modify +it under the terms of the GNU General Public License as published by +the Free Software Foundation; either version 3, or (at your option) +any later version. + +GCC is distributed in the hope that it will be useful, +but WITHOUT ANY WARRANTY; without even the implied warranty of +MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the +GNU General Public License for more details. + +You should have received a copy of the GNU General Public License +along with GCC; see the file COPYING3. If not see +. */ + +#include "config.h" +#include "system.h" +#include "coretypes.h" +#include "tm.h" +#include "common/common-target.h" +#include "common/common-target-def.h" +#include "config/bpf/bpf-protos.h" + +#undef TARGET_DEFAULT_TARGET_FLAGS +#define TARGET_DEFAULT_TARGET_FLAGS 0 + +/* Implement TARGET_OPTION_OPTIMIZATION_TABLE. */ +static const struct default_options bpf_option_optimization_table[] = + { + /* Enable -funroll-all-loops by default. */ + { OPT_LEVELS_ALL, OPT_funroll_all_loops, NULL, 1 }, + /* Disable -fomit-frame-pointer by default. */ + { OPT_LEVELS_ALL, OPT_fomit_frame_pointer, NULL, 0 }, + { OPT_LEVELS_NONE, 0, NULL, 0 } + }; + +#undef TARGET_OPTION_OPTIMIZATION_TABLE +#define TARGET_OPTION_OPTIMIZATION_TABLE bpf_option_optimization_table + +/* Implement TARGET_OPTION_DEFAULT_PARAMS. */ + +static void +bpf_option_default_params (void) +{ + /* XXX large-stack-frame = 512 bytes */ + /* XXX max-unrolled-insns */ + /* XXX max-unroll-times */ +} + +#undef TARGET_OPTION_DEFAULT_PARAMS +#define TARGET_OPTION_DEFAULT_PARAMS bpf_option_default_params + +struct gcc_targetm_common targetm_common = TARGETM_COMMON_INITIALIZER; diff --git a/gcc/config.gcc b/gcc/config.gcc index 40cbc52dc99..60673a422a7 100644 --- a/gcc/config.gcc +++ b/gcc/config.gcc @@ -360,6 +360,9 @@ avr-*-*) bfin*-*) cpu_type=bfin ;; +bpf-*-*) + cpu_type=bpf + ;; crisv32-*) cpu_type=cris ;; @@ -1310,6 +1313,12 @@ bfin*-*) use_collect2=no use_gcc_stdint=wrap ;; +bpf-*-*) + tmake_file="${tmake_file} bpf/t-bpf" + use_collect2=no + extra_headers="bpf-helpers.h" + use_gcc_stdint=provide + ;; cr16-*-elf) tm_file="elfos.h ${tm_file} newlib-stdint.h" tmake_file="${tmake_file} cr16/t-cr16 " diff --git a/gcc/config/bpf/bpf-helpers.def b/gcc/config/bpf/bpf-helpers.def new file mode 100644 index 00000000000..4f6b8eb0892 --- /dev/null +++ b/gcc/config/bpf/bpf-helpers.def @@ -0,0 +1,194 @@ +/* Kernel helpers database. + Copyright (C) 2019 Free Software Foundation, Inc. + +This file is part of GCC. + +GCC is free software; you can redistribute it and/or modify +it under the terms of the GNU General Public License as published by +the Free Software Foundation; either version 3, or (at your option) +any later version. + +GCC is distributed in the hope that it will be useful, +but WITHOUT ANY WARRANTY; without even the implied warranty of +MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the +GNU General Public License for more details. + +You should have received a copy of the GNU General Public License +along with GCC; see the file COPYING3. If not see +. */ + +/* This file contains the definition of the kernel helpers that are + available to eBPF programs. + + The primary source for information on kernel helpers is the + linux/include/uapi/linux/bpf.h file in the Linux source tree. + Please keep this database in sync. + + The first column is the first kernel version featuring the helper + function. This should be an enumerate from bpf_kernel_version, + defined in bpf-opts.h. Note that the backend assumes that helpers + never get deprecated in the kernel. If that eventually happens, + then we will need to use a bitmask here instead of an enumerate. + + The second column is the constant-name for the helper. + The third column is the program-name of the helper. + + The fourth column is a list of names describing the types of the + values returned and accepted by the helper, in one of these forms: + + TYPES (type1, type2, ..., 0) + VTYPES (type1, type2, ..., 0) + + VTYPES should be used should the helper accept a variable number of + arguments, TYPES otherwise. The valid type names are: + + `vt' for void. + `it' for signed int. + `ut' for unsigned int. + `pt' for *void. + `cpt' for const *void. + `st' for short int. + `ust' for unsigned short int. + `cst' for const char *. + `ullt' for unsigned long long. + `llt' for long long. + `u32t' for uint32. + `u64t' for uint64. + + In types descriptions, the firt entry corresponds to the value + returned by the helper. Subsequent names correspond to the helper + arguments. Finally, a 0 should close the list. + + VERY IMPORTANT: the helper entries should be listed in the same + order than in the definition of __BPF_FUNC_MAPPER in + linux/include/uapi/linux/bpf.h! */ + +DEF_HELPER (LINUX_V4_0, MAP_LOOKUP_ELEM, map_lookup_elem, TYPES (pt, pt, pt, 0)) +DEF_HELPER (LINUX_V4_0, MAP_UPDATE_ELEM, map_update_elem, TYPES (it, pt, pt, pt, ullt, 0)) +DEF_HELPER (LINUX_V4_0, MAP_DELETE_ELEM, map_delete_elem, TYPES (it, pt, pt, 0)) +DEF_HELPER (LINUX_V4_1, PROBE_READ, probe_read, TYPES (it, pt, ut, cpt, 0)) +DEF_HELPER (LINUX_V4_1, KTIME_GET_NS, ktime_get_ns, TYPES (ullt, 0)) +DEF_HELPER (LINUX_V4_1, TRACE_PRINTK, trace_printk, VTYPES (it, cst, it, 0)) +DEF_HELPER (LINUX_V4_1, GET_PRANDOM_U32, get_prandom_u32, TYPES (ullt, 0)) +DEF_HELPER (LINUX_V4_1, GET_SMP_PROCESSOR_ID, get_smp_processor_id, TYPES (ullt, 0)) +DEF_HELPER (LINUX_V4_1, SKB_STORE_BYTES, skb_store_bytes, TYPES (it, pt, it, pt, it, it, 0)) +DEF_HELPER (LINUX_V4_1, L3_CSUM_REPLACE, l3_csum_replace, TYPES (it, pt, it, it ,it ,it, 0)) +DEF_HELPER (LINUX_V4_1, L4_CSUM_REPLACE, l4_csum_replace, TYPES (it, pt, it, it, it, it, 0)) +DEF_HELPER (LINUX_V4_2, TAIL_CALL, tail_call, TYPES (vt, pt, pt, it, 0)) +DEF_HELPER (LINUX_V4_2, CLONE_REDIRECT, clone_redirect, TYPES (it, pt, it, it, 0)) +DEF_HELPER (LINUX_V4_2, GET_CURRENT_PID_TGID, get_current_pid_tgid, TYPES (ullt, 0)) +DEF_HELPER (LINUX_V4_2, GET_CURRENT_UID_GID, get_current_uid_gid, TYPES (ullt, 0)) +DEF_HELPER (LINUX_V4_2, GET_CURRENT_COMM, get_current_comm, TYPES (it, pt, it, 0)) +DEF_HELPER (LINUX_V4_3, GET_CGROUP_CLASSID, get_cgroup_classid, TYPES (it, pt, 0)) +DEF_HELPER (LINUX_V4_3, SKB_VLAN_PUSH, skb_vlan_push, TYPES (it, pt, st, ust, 0)) +DEF_HELPER (LINUX_V4_3, SKB_VLAN_POP, skb_vlan_pop, TYPES (it, pt, 0)) +DEF_HELPER (LINUX_V4_3, SKB_GET_TUNNEL_KEY, skb_get_tunnel_key, TYPES (it, pt, pt, it, it, 0)) +DEF_HELPER (LINUX_V4_3, SKB_SET_TUNNEL_KEY, skb_set_tunnel_key, TYPES (it, pt, pt, it, it, 0)) +DEF_HELPER (LINUX_V4_3, PERF_EVENT_READ, perf_event_read, TYPES (ullt, pt, ullt, 0)) +DEF_HELPER (LINUX_V4_4, REDIRECT, redirect, TYPES (it, it, it, 0)) +DEF_HELPER (LINUX_V4_4, GET_ROUTE_REALM, get_route_realm, TYPES (ut, pt, 0)) +DEF_HELPER (LINUX_V4_4, PERF_EVENT_OUTPUT, perf_event_output, \ + TYPES (it, pt, pt, ullt, pt, it, 0)) +DEF_HELPER (LINUX_V4_5, SKB_LOAD_BYTES, skb_load_bytes, TYPES (it, pt, it, pt, it, 0)) +DEF_HELPER (LINUX_V4_6, GET_STACKID, get_stackid, TYPES (it, pt, pt, it, 0)) +DEF_HELPER (LINUX_V4_6, CSUM_DIFF, csum_diff, TYPES (it, pt, it, pt, it, it, 0)) +DEF_HELPER (LINUX_V4_6, SKB_GET_TUNNEL_OPT, skb_get_tunnel_opt, TYPES (it, pt, pt, it, 0)) +DEF_HELPER (LINUX_V4_6, SKB_SET_TUNNEL_OPT, skb_set_tunnel_opt, TYPES (it, pt, pt, it, 0)) +DEF_HELPER (LINUX_V4_8, SKB_CHANGE_PROTO, skb_change_proto, TYPES (it, pt, st, u64t, 0)) +DEF_HELPER (LINUX_V4_8, SKB_CHANGE_TYPE, skb_change_type, TYPES (it, pt, u32t, 0)) +DEF_HELPER (LINUX_V4_8, SKB_UNDER_CGROUP, skb_under_cgroup, TYPES (it, pt, pt, it, 0)) +DEF_HELPER (LINUX_V4_8, GET_HASH_RECALC, get_hash_recalc, TYPES (ut, pt, 0)) +DEF_HELPER (LINUX_V4_8, GET_CURRENT_TASK, get_current_task, TYPES (ullt, pt, 0)) +DEF_HELPER (LINUX_V4_8, PROBE_WRITE_USER, probe_write_user, TYPES (it, pt, cpt, ut, 0)) +DEF_HELPER (LINUX_V4_9, CURRENT_TASK_UNDER_CGROUP, current_task_under_cgroup, \ + TYPES (it, pt, it, 0)) +DEF_HELPER (LINUX_V4_9, SKB_CHANGE_TAIL, skb_change_tail, TYPES (it, pt, ut, u64t, 0)) +DEF_HELPER (LINUX_V4_9, SKB_PULL_DATA, skb_pull_data, TYPES (it, pt, it, 0)) +DEF_HELPER (LINUX_V4_9, CSUM_UPDATE, csum_update, TYPES (llt, pt, u32t, 0)) +DEF_HELPER (LINUX_V4_9, SET_HASH_INVALID, set_hash_invalid, TYPES (vt, pt, 0)) +DEF_HELPER (LINUX_V4_10, GET_NUMA_NODE_ID, get_numa_node_id, TYPES (it, 0)) +DEF_HELPER (LINUX_V4_10, SKB_CHANGE_HEAD, skb_change_head, TYPES (it, pt, it, it, 0)) +DEF_HELPER (LINUX_V4_10, XDP_ADJUST_HEAD, xdp_adjust_head, TYPES (it, pt, it, 0)) +DEF_HELPER (LINUX_V4_11, PROBE_READ_STR, probe_read_str, TYPES (it, pt, u32t, cpt, 0)) +DEF_HELPER (LINUX_V4_12, GET_SOCKET_COOKIE, get_socket_cookie, TYPES (it, pt, 0)) +DEF_HELPER (LINUX_V4_12, GET_SOCKET_UID, get_socket_uid, TYPES (ut, pt, 0)) +DEF_HELPER (LINUX_V4_13, SET_HASH, set_hash, TYPES (ut, pt, u32t, 0)) +DEF_HELPER (LINUX_V4_13, SETSOCKOPT, setsockopt, TYPES (it, pt, it, it, pt, it, 0)) +DEF_HELPER (LINUX_V4_13, SKB_ADJUST_ROOM, skb_adjust_room, TYPES (it, pt, st, u32t, ullt, 0)) +DEF_HELPER (LINUX_V4_14, REDIRECT_MAP, redirect_map, TYPES (it, pt, it, it, 0)) +DEF_HELPER (LINUX_V4_14, SK_REDIRECT_MAP, sk_redirect_map, TYPES (it, pt, pt, it, it, 0)) +DEF_HELPER (LINUX_V4_14, SOCK_MAP_UPDATE, sock_map_update, TYPES (it, pt, pt, pt, ullt, 0)) +DEF_HELPER (LINUX_V4_15, XDP_ADJUST_META, xdp_adjust_meta, TYPES (it, pt, it, 0)) +DEF_HELPER (LINUX_V4_15, PERF_EVENT_READ_VALUE, perf_event_read_value, + TYPES (it, pt, ullt, pt, ut, 0)) +DEF_HELPER (LINUX_V4_15, PERF_PROG_READ_VALUE, perf_prog_read_value, + TYPES (it, pt, pt, ut, 0)) +DEF_HELPER (LINUX_V4_15, GETSOCKOPT, getsockopt, TYPES (it, pt, it, it, pt, it, 0)) + +DEF_HELPER (LINUX_V4_16, OVERRIDE_RETURN, override_return, TYPES (it, pt, ult, 0)) +DEF_HELPER (LINUX_V4_16, SOCK_OPS_CB_FLAGS_SET, sock_ops_cb_flags_set, TYPES (it, pt, it, 0)) +DEF_HELPER (LINUX_V4_17, MSG_REDIRECT_MAP, msg_redirect_map, TYPES (it, pt, pt, it, it, 0)) +DEF_HELPER (LINUX_V4_17, MSG_APPLY_BYTES, msg_apply_bytes, TYPES (it, pt, it, 0)) +DEF_HELPER (LINUX_V4_17, MSG_CORK_BYTES, msg_cork_bytes, TYPES (it, pt, it, 0)) +DEF_HELPER (LINUX_V4_17, MSG_PULL_DATA, msg_pull_data, TYPES (it, pt, it, it, it, 0)) +DEF_HELPER (LINUX_V4_17, BIND, bind, TYPES (it, pt, pt, it, 0)) +DEF_HELPER (LINUX_V4_18, XDP_ADJUST_TAIL, xdp_adjust_tail, TYPES (it, pt, it, 0)) +DEF_HELPER (LINUX_V4_18, SKB_GET_XFRM_STATE, + skb_get_xfrm_state, TYPES (it, pt, it, pt, it, it, 0)) +DEF_HELPER (LINUX_V4_18, GET_STACK, get_stack, TYPES (it, pt, pt, it, it, 0)) +DEF_HELPER (LINUX_V4_18, SKB_LOAD_BYTES_RELATIVE, skb_load_bytes_relative, + TYPES (it, pt, it, pt, it, ut, 0)) +DEF_HELPER (LINUX_V4_18, FIB_LOOKUP, fib_lookup, TYPES (it, pt, pt, it, ut, 0)) +DEF_HELPER (LINUX_V4_18, SOCK_HASH_UPDATE, sock_hash_update, TYPES (it, pt, pt, pt, ullt, 0)) +DEF_HELPER (LINUX_V4_18, MSG_REDIRECT_HASH, msg_redirect_hash, TYPES (it, pt, pt, pt, it, 0)) +DEF_HELPER (LINUX_V4_18, SK_REDIRECT_HASH, sk_redirect_hash, TYPES (it, pt, pt, pt, it, 0)) +DEF_HELPER (LINUX_V4_18, LWT_PUSH_ENCAP, lwt_push_encap, TYPES (it, pt, ut, pt, ut, 0)) +DEF_HELPER (LINUX_V4_18, LWT_SEG6_STORE_BYTES, lwt_seg6_store_bytes, + TYPES (it, pt, ut, pt, ut, 0)) +DEF_HELPER (LINUX_V4_18, LWT_SEG6_ADJUST_SRH, lwt_seg6_adjust_srh, TYPES (it, pt, ut, ut, 0)) +DEF_HELPER (LINUX_V4_18, LWT_SEG6_ACTION, lwt_seg6_action, TYPES (it, pt, ut, pt, ut, 0)) +DEF_HELPER (LINUX_V4_18, RC_REPEAT, rc_repeat, TYPES (it, pt, 0)) +DEF_HELPER (LINUX_V4_18, RC_KEYDOWN, rc_keydown, TYPES (it, pt, ut, ullt, ut, 0)) +DEF_HELPER (LINUX_V4_18, SKB_CGROUP_ID, skb_cgroup_id, TYPES (ullt, pt, 0)) +DEF_HELPER (LINUX_V4_18, GET_CURRENT_CGROUP_ID, get_current_cgroup_id, TYPES (ullt, 0)) +DEF_HELPER (LINUX_V4_19, GET_LOCAL_STORAGE, get_local_storage, TYPES (pt, pt, ullt, 0)) +DEF_HELPER (LINUX_V4_19, SK_SELECT_REUSEPORT, sk_select_reuseport, + TYPES (it, pt, pt, pt, ut, 0)) +DEF_HELPER (LINUX_V4_19, SKB_ANCESTOR_CGROUP_ID, skb_ancestor_cgroup_id, + TYPES (ullt, pt, it, 0)) +DEF_HELPER (LINUX_V4_20, SK_LOOKUP_TCP, sk_lookup_tcp, TYPES (pt, pt, pt, it, ullt, ullt, 0)) +DEF_HELPER (LINUX_V4_20, SK_LOOKUP_UDP, sk_lookup_udp, TYPES (pt, pt, pt, it, ullt, ullt, 0)) +DEF_HELPER (LINUX_V4_20, SK_RELEASE, sk_release, TYPES (it, pt, 0)) +DEF_HELPER (LINUX_V4_20, MAP_PUSH_ELEM, map_push_elem, TYPES (it, pt, pt, ullt, 0)) +DEF_HELPER (LINUX_V4_20, MAP_POP_ELEM, map_pop_elem, TYPES (it, pt, pt, 0)) +DEF_HELPER (LINUX_V4_20, MAP_PEEK_ELEM, map_peek_elem, TYPES (it, pt, pt, 0)) +DEF_HELPER (LINUX_V4_20, MSG_PUSH_DATA, msg_push_data, TYPES (it, pt, it, it, it, 0)) +DEF_HELPER (LINUX_V5_0, MSG_POP_DATA, msg_pop_data, TYPES (it, pt, it, it, it, 0)) +DEF_HELPER (LINUX_V5_0, RC_POINTER_REL, rc_pointer_rel, TYPES (it, pt, it, it, 0)) +DEF_HELPER (LINUX_V5_1, SPIN_LOCK, spin_lock, TYPES (vt, pt, 0)) +DEF_HELPER (LINUX_V5_1, SPIN_UNLOCK, spin_unlock, TYPES (vt, pt, 0)) +DEF_HELPER (LINUX_V5_1, SK_FULLSOCK, sk_fullsock, TYPES (pt, pt, 0)) +DEF_HELPER (LINUX_V5_1, TCP_SOCK, tcp_sock, TYPES (pt, pt, 0)) +DEF_HELPER (LINUX_V5_1, SKB_ECN_SET_CE, skb_ecn_set_ce, TYPES (it, pt, 0)) +DEF_HELPER (LINUX_V5_1, GET_LISTENER_SOCK, get_listener_sock, TYPES (pt, pt, 0)) +DEF_HELPER (LINUX_V5_2, SKC_LOOKUP_TCP, skc_lookup_tcp, + TYPES (pt, pt, pt, u32t, u64t, u64t, 0)) +DEF_HELPER (LINUX_V5_2, TCP_CHECK_SYNCOOKIE, tcp_check_syncookie, + TYPES (it, pt, pt, u32t, pt, u32t, 0)) +DEF_HELPER (LINUX_V5_2, SYSCTL_GET_NAME, sysctl_get_name, TYPES (it, pt, pt, ullt, u64t, 0)) +DEF_HELPER (LINUX_V5_2, SYSCTL_GET_CURRENT_VALUE, sysctl_get_current_value, + TYPES (it, pt, pt, ullt, 0)) +DEF_HELPER (LINUX_V5_2, SYSCTL_GET_NEW_VALUE, sysctl_get_new_value, + TYPES (it, pt, pt, ullt, 0)) +DEF_HELPER (LINUX_V5_2, SYSCTL_SET_NEW_VALUE, sysctl_set_new_value, + TYPES (it, pt, pt, ullt, 0)) +DEF_HELPER (LINUX_V5_2, STRTOL, strtol, TYPES (it, cst, ullt, u64t, pt, 0)) +DEF_HELPER (LINUX_V5_2, STRTOUL, strtoul, TYPES (it, pt, ullt, u64t, pt, 0)) +DEF_HELPER (LINUX_V5_2, SK_STORAGE_GET, sk_storage_get, TYPES (pt, pt, pt, pt, u64t, 0)) +DEF_HELPER (LINUX_V5_2, SK_STORAGE_DELETE, sk_storage_delete, TYPES (it, pt, pt, 0)) + +/* +Local variables: +mode:c +End: +*/ diff --git a/gcc/config/bpf/bpf-helpers.h b/gcc/config/bpf/bpf-helpers.h new file mode 100644 index 00000000000..2fe96be7637 --- /dev/null +++ b/gcc/config/bpf/bpf-helpers.h @@ -0,0 +1,324 @@ +/* Copyright (C) 2019 Free Software Foundation, Inc. + + This file is part of GCC. + + GCC is free software; you can redistribute it and/or modify + it under the terms of the GNU General Public License as published by + the Free Software Foundation; either version 3, or (at your option) + any later version. + + GCC is distributed in the hope that it will be useful, + but WITHOUT ANY WARRANTY; without even the implied warranty of + MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the + GNU General Public License for more details. + + Under Section 7 of GPL version 3, you are granted additional + permissions described in the GCC Runtime Library Exception, version + 3.1, as published by the Free Software Foundation. + + You should have received a copy of the GNU General Public License and + a copy of the GCC Runtime Library Exception along with this program; + see the files COPYING3 and COPYING.RUNTIME respectively. If not, see + . */ + +/* The purpose of this file is to provide a compatiblity layer with + the Linux kernel bpf_helpers.h header that is located in + linux/tools/testing/selftests/bpf/bpf_helpers.h. That file is + currently llvm-specific. */ + +#ifndef __BPF_HELPERS_H +#define __BPF_HELPERS_H + +#define SEC(NAME) __attribute__((section(NAME), used)) + +/* Flags used in some kernel helpers. */ + +#define BPF_ANY 0 +#define BPF_NOEXIST 1 +#define BPF_EXIST 2 + +#define BPF_F_LOCK 4 +#define BPF_F_NO_COMMON_LRU (1U << 1) +#define BPF_F_NUMA_NODE (1U << 2) + +/* Functions to call kernel helpers. We provide the "standard" bpf_* + names as synonyms of the corresponding GCC builtins. In some + cases, where non-void pointers are passed to the helper, inline + functions are used to achieve proper type checking. */ + +#ifndef KERNEL_VERSION +# define KERNEL_VERSION(a,b,c) (((a) << 16) + ((b) << 8) + (c)) +#endif + +#if __BPF_KERNEL_VERSION_CODE__ >= KERNEL_VERSION (4,0,0) + +#define bpf_map_lookup_elem __builtin_bpf_helper_map_lookup_elem +#define bpf_map_update_elem __builtin_bpf_helper_map_update_elem +#define bpf_map_delete_elem __builtin_bpf_helper_map_delete_elem + +#if __BPF_KERNEL_VERSION_CODE__ >= KERNEL_VERSION (4,1,0) + +#define bpf_probe_read __builtin_bpf_helper_probe_read +#define bpf_ktime_get_ns __builtin_bpf_helper_ktime_get_ns +#define bpf_trace_printk __builtin_bpf_helper_trace_printk +#define bpf_get_prandom_u32 __builtin_bpf_helper_get_prandom_u32 +#define bpf_get_smp_processor_id __builtin_bpf_helper_get_smp_processor_id +#define bpf_skb_store_bytes __builtin_bpf_helper_skb_store_bytes +#define bpf_l3_csum_replace __builtin_bpf_helper_l3_csum_replace +#define bpf_l4_csum_replace __builtin_bpf_helper_l4_csum_replace + +#if __BPF_KERNEL_VERSION_CODE__ >= KERNEL_VERSION (4,2,0) + +#define bpf_tail_call __builtin_bpf_helper_tail_call +#define bpf_clone_redirect __builtin_bpf_helper_clone_redirect +#define bpf_get_current_pid_tgid __builtin_bpf_helper_get_current_pid_tgid +#define bpf_get_current_uid_gid __builtin_bpf_helper_get_current_uid_gid +#define bpf_get_current_comm __builtin_bpf_helper_get_current_comm + +#if __BPF_KERNEL_VERSION_CODE__ >= KERNEL_VERSION (4,3,0) + +#define bpf_get_cgroup_classid __builtin_bpf_helper_get_cgroup_classid +#define bpf_skb_vlan_push __builtin_bpf_helper_skb_vlan_push +#define bpf_skb_vlan_pop __builtin_bpf_helper_skb_vlan_pop +#define bpf_skb_get_tunnel_key __builtin_bpf_helper_skb_get_tunnel_key +#define bpf_skb_set_tunnel_key __builtin_bpf_helper_skb_set_tunnel_key +#define bpf_perf_event_read __builtin_bpf_helper_perf_event_read + +#if __BPF_KERNEL_VERSION_CODE__ >= KERNEL_VERSION (4,4,0) + +#define bpf_redirect __builtin_bpf_helper_redirect +#define bpf_get_route_realm __builtin_bpf_helper_get_route_realm +#define bpf_perf_event_output __builtin_bpf_helper_perf_event_output + +#if __BPF_KERNEL_VERSION_CODE__ >= KERNEL_VERSION (4,5,0) + +#define bpf_skb_load_bytes __builtin_bpf_helper_skb_load_bytes + +#if __BPF_KERNEL_VERSION_CODE__ >= KERNEL_VERSION (4,6,0) + +#define bpf_get_stackid __builtin_bpf_helper_get_stackid +#define bpf_csum_diff __builtin_bpf_helper_csum_diff +#define bpf_skb_get_tunnel_opt __builtin_bpf_helper_skb_get_tunnel_opt +#define bpf_skb_set_tunnel_opt __builtin_bpf_helper_skb_set_tunnel_opt + +#if __BPF_KERNEL_VERSION_CODE__ >= KERNEL_VERSION (4,8,0) + +#define bpf_skb_change_proto __builtin_bpf_helper_skb_change_proto +#define bpf_skb_change_type __builtin_bpf_helper_skb_change_type +#define bpf_skb_under_cgroup __builtin_bpf_helper_skb_under_cgroup +#define bpf_get_hash_recalc __builtin_bpf_helper_get_hash_recalc +#define bpf_get_current_task __builtin_bpf_helper_get_current_task +#define bpf_probe_write_user __builtin_bpf_helper_probe_write_user + +#if __BPF_KERNEL_VERSION_CODE__ >= KERNEL_VERSION (4,9,0) + +#define bpf_current_task_under_cgroup __builtin_bpf_helper_current_task_under_cgroup +#define bpf_skb_change_tail __builtin_bpf_helper_skb_change_tail +#define bpf_skb_pull_data __builtin_bpf_helper_skb_pull_data +#define bpf_csum_update __builtin_bpf_helper_csum_update +#define bpf_set_hash_invalid __builtin_bpf_helper_set_hash_invalid + +#if __BPF_KERNEL_VERSION_CODE__ >= KERNEL_VERSION (4,10,0) + +#define bpf_get_numa_node_id __builtin_bpf_helper_get_numa_node_id +#define bpf_skb_change_head __builtin_bpf_helper_skb_change_head +#define bpf_xdp_adjust_head __builtin_bpf_helper_xdp_adjust_head + +#if __BPF_KERNEL_VERSION_CODE__ >= KERNEL_VERSION (4,11,0) + +#define bpf_probe_read_str __builtin_bpf_helper_probe_read_str + +#if __BPF_KERNEL_VERSION_CODE__ >= KERNEL_VERSION (4,12,0) + +#define bpf_get_socket_cookie __builtin_bpf_helper_get_socket_cookie +#define bpf_get_socket_uid __builtin_bpf_helper_get_socket_uid + +#if __BPF_KERNEL_VERSION_CODE__ >= KERNEL_VERSION (4,13,0) + +#define bpf_set_hash __builtin_bpf_helper_set_hash +#define bpf_setsockopt __builtin_bpf_helper_setsockopt +#define bpf_skb_adjust_room __builtin_bpf_helper_skb_adjust_room + +#if __BPF_KERNEL_VERSION_CODE__ >= KERNEL_VERSION (4,14,0) + +#define bpf_redirect_map __builtin_bpf_helper_redirect_map +#define bpf_sk_redirect_map __builtin_bpf_helper_sk_redirect_map +#define bpf_sock_map_update __builtin_bpf_helper_sock_map_update + +#if __BPF_KERNEL_VERSION_CODE__ >= KERNEL_VERSION (4,15,0) + +#define bpf_perf_event_read_value __builtin_bpf_helper_perf_event_read_value +#define bpf_perf_prog_read_value __builtin_bpf_helper_perf_prog_read_value +#define bpf_getsockopt __builtin_bpf_helper_getsockopt +#define bpf_xdp_adjust_meta __builtin_bpf_helper_xdp_adjust_meta + +#if __BPF_KERNEL_VERSION_CODE__ >= KERNEL_VERSION (4,16,0) + +#define bpf_override_return __builtin_bpf_helper_override_return +#define bpf_sock_ops_cb_flags_set __builtin_bpf_helper_sock_ops_cb_flags_set + +#if __BPF_KERNEL_VERSION_CODE__ >= KERNEL_VERSION (4,17,0) + +#define bpf_msg_redirect_map __builtin_bpf_helper_msg_redirect_map +#define bpf_msg_apply_bytes __builtin_bpf_helper_msg_apply_bytes +#define bpf_msg_cork_bytes __builtin_bpf_helper_msg_cork_bytes +#define bpf_pull_data __builtin_bpf_helper_pull_data +#define bpf_bind __builtin_bpf_helper_bpf_bind + +#if __BPF_KERNEL_VERSION_CODE__ >= KERNEL_VERSION (4,18,0) + +#define bpf_xdp_adjust_tail __builtin_bpf_helper_xdp_adjust_tail +#define bpf_skb_get_xfrm_state __builtin_bpf_helper_skb_get_xfrm_state +#define bpf_get_stack __builtin_bpf_helper_get_stack +#define bpf_skb_load_bytes_relative __builtin_bpf_helper_skb_load_bytes_relative +#define bpf_sock_hash_update __builtin_bpf_helper_sock_hash_update +#define bpf_msg_redirect_hash __builtin_bpf_helper_msg_redirect_hash +#define bpf_sk_redirect_hash __builtin_bpf_helper_sk_redirect_hash +#define bpf_lwt_push_encap __builtin_bpf_helper_lwt_push_encap +#define bpf_lwt_seg6_store_bytes __builtin_bpf_helper_lwt_seg6_store_bytes +#define bpf_lwt_seg6_adjust_srh __builtin_bpf_helper_lwt_seg6_adjust_srh +#define bpf_lwt_seg6_action __builtin_bpf_helper_lwt_seg6_action +#define bpf_rc_repeat __builtin_bpf_helper_rc_repeat +#define bpf_rc_keydown __builtin_bpf_helper_rc_keydown +#define bpf_skb_cgroup_id __builtin_bpf_helper_skb_cgroup_id +#define bpf_get_current_cgroup_id __builtin_bpf_helper_get_current_cgroup_id + +static inline int +bpf_fib_lookup (void *ctx, struct bpf_fib_lookup *param, int plen, + unsigned int flags) +{ + return __builtin_bpf_helper_fib_lookup (ctx, (void *) param, plen, flags); +} + + +#if __BPF_KERNEL_VERSION_CODE__ >= KERNEL_VERSION (4,19,0) + +#define bpf_get_local_storage __builtin_bpf_helper_get_local_storage +#define bpf_sk_select_reuseport __builtin_bpf_helper_sk_select_reuseport +#define bpf_skb_ancestor_cgroup_id __builtin_bpf_helper_skb_ancestor_cgroup_id + +#if __BPF_KERNEL_VERSION_CODE__ >= KERNEL_VERSION (4,20,0) + +#define bpf_sk_release __builtin_bpf_helper_sk_release +#define bpf_map_push_elem __builtin_bpf_helper_map_push_elem +#define bpf_map_pop_elem __builtin_bpf_helper_map_pop_elem +#define bpf_map_peek_elem __builtin_bpf_helper_map_peek_elem +#define bpf_msg_push_data __builtin_bpf_helper_msg_push_data + +static inline struct bpf_sock * +bpf_sk_lookup_tcp (void *ctx, struct bpf_sock_tuple *tuple, + int size, unsigned long long netns_id, + unsigned long long flags) +{ + return + (struct bpf_sock *) __builtin_bpf_helper_sk_lookup_tcp (ctx, + (void *) tuple, + size, + netns_id, flags); +} + +static inline struct bpf_sock * +bpf_sk_lookup_udp (void *ctx, struct bpf_sock_tuple *tuple, + int size, unsigned long long netns_id, + unsigned long long flags) +{ + return + (struct bpf_sock *) __builtin_bpf_helper_sk_lookup_udp (ctx, + (void *) tuple, + size, + netns_id, flags); +} + +#if __BPF_KERNEL_VERSION_CODE__ >= KERNEL_VERSION (5,0,0) + +#define bpf_msg_pop_data __builtin_bpf_helper_pop_data +#define bpf_rc_pointer_rel __builtin_bpf_helper_rc_pointer_rel + +#if __BPF_KERNEL_VERSION_CODE__ >= KERNEL_VERSION (5,1,0) + +#define bpf_spin_lock __builtin_bpf_helper_spin_lock +#define bpf_spin_unlock __builtin_bpf_helper_spin_unlock +#define bpf_skb_ecn_set_ce __builtin_bpf_helper_skb_ecn_set_ce + +static inline struct bpf_sock * +bpf_sk_fullsock (struct bpf_sock *sk) +{ + return + (struct bpf_sock *) __builtin_bpf_helper_sk_fullsock ((void *) sk); +} + +static inline struct bpf_sock * +bpf_tcp_sock (struct bpf_sock *sk) +{ + return + (struct bpf_sock *) __builtin_bpf_helper_tcp_sock ((void *) sk); +} + +static inline struct bpf_sock * +bpf_get_listener_sock (struct bpf_sock *sk) +{ + return + (struct bpf_sock *) __builtin_bpf_helper_get_listener_sock ((void *) sk); +} + +#if __BPF_KERNEL_VERSION_CODE__ >= KERNEL_VERSION (5,2,0) + + +#endif /* 5.2 */ +#endif /* 5.1 */ +#endif /* 5.0 */ +#endif /* 4.20 */ +#endif /* 4.19 */ +#endif /* 4.18 */ +#endif /* 4.17 */ +#endif /* 4.16 */ +#endif /* 4.15 */ +#endif /* 4.14 */ +#endif /* 4.13 */ +#endif /* 4.12 */ +#endif /* 4.11 */ +#endif /* 4.10 */ +#endif /* 4.9 */ +#endif /* 4.8 */ +#endif /* 4.6 */ +#endif /* 4.5 */ +#endif /* 4.4 */ +#endif /* 4.3 */ +#endif /* 4.2 */ +#endif /* 4.1 */ +#endif /* 4.0 */ + +/* Functions to emit BPF_LD_ABS and BPF_LD_IND instructions. We + provide the "standard" names as synonyms of the corresponding GCC + builtins. Note how the SKB argument is ignored. */ + +static inline long long +load_byte (void *skb, unsigned long long off) +{ + return __builtin_bpf_load_byte (off); +} + +static inline long long +load_half (void *skb, unsigned long long off) +{ + return __builtin_bpf_load_half (off); +} + +static inline long long +load_word (void *skb, unsigned long long off) +{ + return __builtin_bpf_load_word (off); +} + +struct bpf_map_def +{ + unsigned int type; + unsigned int key_size; + unsigned int value_size; + unsigned int max_entries; + unsigned int map_flags; + unsigned int inner_map_idx; + unsigned int numa_node; +}; + +#endif /* ! __BPF_HELPERS_H */ diff --git a/gcc/config/bpf/bpf-opts.h b/gcc/config/bpf/bpf-opts.h new file mode 100644 index 00000000000..5c76a40f131 --- /dev/null +++ b/gcc/config/bpf/bpf-opts.h @@ -0,0 +1,56 @@ +/* Definitions for option handling for eBPF. + Copyright (C) 2019 Free Software Foundation, Inc. + + This file is part of GCC. + + GCC is free software; you can redistribute it and/or modify it + under the terms of the GNU General Public License as published by + the Free Software Foundation; either version 3, or (at your option) + any later version. + + GCC is distributed in the hope that it will be useful, but WITHOUT + ANY WARRANTY; without even the implied warranty of MERCHANTABILITY + or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public + License for more details. + + You should have received a copy of the GNU General Public License + along with GCC; see the file COPYING3. If not see + . */ + +#ifndef BPF_OPTS_H +#define BPF_OPTS_H + +/* Supported versions of the Linux kernel. */ +enum bpf_kernel_version +{ + /* Linux 4.x */ + LINUX_V4_0, + LINUX_V4_1, + LINUX_V4_2, + LINUX_V4_3, + LINUX_V4_4, + LINUX_V4_5, + LINUX_V4_6, + LINUX_V4_7, + LINUX_V4_8, + LINUX_V4_9, + LINUX_V4_10, + LINUX_V4_11, + LINUX_V4_12, + LINUX_V4_13, + LINUX_V4_14, + LINUX_V4_15, + LINUX_V4_16, + LINUX_V4_17, + LINUX_V4_18, + LINUX_V4_19, + LINUX_V4_20, + /* Linux 5.x */ + LINUX_V5_0, + LINUX_V5_1, + LINUX_V5_2, + LINUX_LATEST = LINUX_V5_2, + LINUX_NATIVE, +}; + +#endif /* ! BPF_OPTS_H */ diff --git a/gcc/config/bpf/bpf-protos.h b/gcc/config/bpf/bpf-protos.h new file mode 100644 index 00000000000..3a835f4f12e --- /dev/null +++ b/gcc/config/bpf/bpf-protos.h @@ -0,0 +1,33 @@ +/* Definition of eBPF target for GNU compiler. + Copyright (C) 2019 Free Software Foundation, Inc. + +This file is part of GCC. + +GCC is free software; you can redistribute it and/or modify +it under the terms of the GNU General Public License as published by +the Free Software Foundation; either version 3, or (at your option) +any later version. + +GCC is distributed in the hope that it will be useful, +but WITHOUT ANY WARRANTY; without even the implied warranty of +MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the +GNU General Public License for more details. + +You should have received a copy of the GNU General Public License +along with GCC; see the file COPYING3. If not see +. */ + +#ifndef GCC_BPF_PROTOS_H +#define GCC_BPF_PROTOS_H + +/* Routines implemented in bpf.c. */ + +extern HOST_WIDE_INT bpf_initial_elimination_offset (int, int); +extern const char *bpf_output_call (rtx); +extern void bpf_target_macros (cpp_reader *); +extern void bpf_print_operand (FILE *, rtx, int); +extern void bpf_print_operand_address (FILE *, rtx); +extern void bpf_expand_prologue (void); +extern void bpf_expand_epilogue (void); + +#endif /* ! GCC_BPF_PROTOS_H */ diff --git a/gcc/config/bpf/bpf.c b/gcc/config/bpf/bpf.c new file mode 100644 index 00000000000..f2fc22bf19c --- /dev/null +++ b/gcc/config/bpf/bpf.c @@ -0,0 +1,1136 @@ +/* Subroutines used for code generation for eBPF. + Copyright (C) 2019 Free Software Foundation, Inc. + +This file is part of GCC. + +GCC is free software; you can redistribute it and/or modify +it under the terms of the GNU General Public License as published by +the Free Software Foundation; either version 3, or (at your option) +any later version. + +GCC is distributed in the hope that it will be useful, +but WITHOUT ANY WARRANTY; without even the implied warranty of +MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the +GNU General Public License for more details. + +You should have received a copy of the GNU General Public License +along with GCC; see the file COPYING3. If not see +. */ + +#define IN_TARGET_CODE 1 + +#define INCLUDE_STRING +#include "config.h" +#include "system.h" +#include "coretypes.h" +#include "tm.h" +#include "rtl.h" +#include "regs.h" +#include "insn-config.h" +#include "insn-attr.h" +#include "recog.h" +#include "output.h" +#include "alias.h" +#include "tree.h" +#include "stringpool.h" +#include "attribs.h" +#include "varasm.h" +#include "stor-layout.h" +#include "calls.h" +#include "function.h" +#include "explow.h" +#include "memmodel.h" +#include "emit-rtl.h" +#include "reload.h" +#include "tm_p.h" +#include "target.h" +#include "target-def.h" +#include "basic-block.h" +#include "expr.h" +#include "optabs.h" +#include "bitmap.h" +#include "df.h" +#include "c-family/c-common.h" +#include "diagnostic.h" +#include "builtins.h" +#include "predict.h" +#include "langhooks.h" + +/* Per-function machine data. */ +struct GTY(()) machine_function +{ + /* Number of bytes saved on the stack for local variables. */ + int local_vars_size; + + /* Number of bytes saved on the stack for callee-saved + registers. */ + int callee_saved_reg_size; + + /* Whether diagnostics for the function have been + checked/reported. */ + int diagnostics_checked_p; +}; + +/* Data structures for the eBPF specific built-ins. */ + +/* Maximum number of arguments taken by a builtin function, plus + one. */ +#define BPF_BUILTIN_MAX_ARGS 5 + +enum bpf_builtins +{ + BPF_BUILTIN_UNUSED = 0, + /* Built-ins for kernel helpers. */ +#define DEF_HELPER(V,D,N,T) BPF_BUILTIN_HELPER_##D, +# include "bpf-helpers.def" +#undef DEF_HELPER + BPF_BUILTIN_HELPER_MAX, + /* Built-ins for non-generic loads and stores. */ + BPF_BUILTIN_LOAD_BYTE = BPF_BUILTIN_HELPER_MAX, + BPF_BUILTIN_LOAD_HALF, + BPF_BUILTIN_LOAD_WORD, + BPF_BUILTIN_MAX, +}; + +/* This table is indexed by an enum bpf_builtin. */ +static const char *bpf_helper_names[] = +{ + NULL, +#define DEF_HELPER(V,D,N,T) #N, +# include "bpf-helpers.def" +#undef DEF_HELPER + NULL, + NULL, + NULL, + NULL +}; + +/* Return the builtin code corresponding to the kernel helper builtin + __builtin_NAME, or 0 if the name doesn't correspond to a kernel + helper builtin. */ + +static inline int +bpf_helper_code (const char *name) +{ + int i; + + for (i = 1; i < BPF_BUILTIN_HELPER_MAX; ++i) + { + if (strcmp (name, bpf_helper_names[i]) == 0) + return i; + } + + return 0; +} + +static GTY (()) tree bpf_builtins[(int) BPF_BUILTIN_MAX]; + +/* Initialize the per-function machine status. */ + +static struct machine_function * +bpf_init_machine_status (void) +{ + /* Note this initializes all fields to 0, which is just OK for + us. */ + return ggc_cleared_alloc (); +} + +/* Override options and do some other initialization. */ + +static void +bpf_option_override (void) +{ + /* Set the default target kernel if no -mkernel was specified. */ + if (!global_options_set.x_bpf_kernel) + bpf_kernel = LINUX_LATEST; + + /* Set the initializer for the per-function status structure. */ + init_machine_status = bpf_init_machine_status; +} + +#undef TARGET_OPTION_OVERRIDE +#define TARGET_OPTION_OVERRIDE bpf_option_override + +/* Determine whether the port is prepared to handle insns involving + scalar mode MODE. For a scalar mode to be considered supported, + all the basic arithmetic and comparisons must work. */ + +static bool +bpf_scalar_mode_supported_p (scalar_mode mode) +{ + switch (mode) + { + case E_QImode: + case E_HImode: + case E_SImode: + case E_DImode: + case E_TImode: + return true; + + default: + return false; + } + + return false; +} + +#undef TARGET_SCALAR_MODE_SUPPORTED_P +#define TARGET_SCALAR_MODE_SUPPORTED_P bpf_scalar_mode_supported_p + +/* Define target-specific CPP macros. This function in used in the + definition of TARGET_CPU_CPP_BUILTINS in bpf.h */ + +#define builtin_define(TXT) cpp_define (pfile, TXT) + +void +bpf_target_macros (cpp_reader *pfile) +{ + builtin_define ("__BPF__"); + + if (TARGET_LITTLE_ENDIAN) + builtin_define ("__BPF_LITTLE_ENDIAN__"); + else + builtin_define ("__BPF_BIG_ENDIAN__"); + + /* Define BPF_KERNEL_VERSION_CODE */ + { + const char *version_code; + char *kernel_version_code; + + switch (bpf_kernel) + { + case LINUX_V4_0: version_code = "0x40000"; break; + case LINUX_V4_1: version_code = "0x40100"; break; + case LINUX_V4_2: version_code = "0x40200"; break; + case LINUX_V4_3: version_code = "0x40300"; break; + case LINUX_V4_4: version_code = "0x40400"; break; + case LINUX_V4_5: version_code = "0x40500"; break; + case LINUX_V4_6: version_code = "0x40600"; break; + case LINUX_V4_7: version_code = "0x40700"; break; + case LINUX_V4_8: version_code = "0x40800"; break; + case LINUX_V4_9: version_code = "0x40900"; break; + case LINUX_V4_10: version_code = "0x40a00"; break; + case LINUX_V4_11: version_code = "0x40b00"; break; + case LINUX_V4_12: version_code = "0x40c00"; break; + case LINUX_V4_13: version_code = "0x40d00"; break; + case LINUX_V4_14: version_code = "0x40e00"; break; + case LINUX_V4_15: version_code = "0x40f00"; break; + case LINUX_V4_16: version_code = "0x41000"; break; + case LINUX_V4_17: version_code = "0x42000"; break; + case LINUX_V4_18: version_code = "0x43000"; break; + case LINUX_V4_19: version_code = "0x44000"; break; + case LINUX_V4_20: version_code = "0x45000"; break; + case LINUX_V5_0: version_code = "0x50000"; break; + case LINUX_V5_1: version_code = "0x50100"; break; + case LINUX_V5_2: version_code = "0x50200"; break; + default: + gcc_unreachable (); + } + +#define KERNEL_VERSION_CODE "__BPF_KERNEL_VERSION_CODE__=" + kernel_version_code + = (char *) alloca (sizeof (KERNEL_VERSION_CODE + 7 + 1)); + strcpy (kernel_version_code, KERNEL_VERSION_CODE); +#undef KERNEL_VERSION_CODE + strcat (kernel_version_code, version_code); + builtin_define (kernel_version_code); + } +} + +/* Output assembly directives to switch to section NAME. The section + should have attributes as specified by FLAGS, which is a bit mask + of the 'SECTION_*' flags defined in 'output.h'. If DECL is + non-NULL, it is the 'VAR_DECL' or 'FUNCTION_DECL' with which this + section is associated. */ + +static void +bpf_asm_named_section (const char *name, + unsigned int flags ATTRIBUTE_UNUSED, + tree decl ATTRIBUTE_UNUSED) +{ + fprintf (asm_out_file, "\t.section\t%s\n", name); +} + +#undef TARGET_ASM_NAMED_SECTION +#define TARGET_ASM_NAMED_SECTION bpf_asm_named_section + +/* Return an RTX representing the place where a function returns or + receives a value of data type RET_TYPE, a tree node representing a + data type. */ + +static rtx +bpf_function_value (const_tree ret_type, + const_tree fntype_or_decl ATTRIBUTE_UNUSED, + bool outgoing ATTRIBUTE_UNUSED) +{ + enum machine_mode mode; + int unsignedp; + + mode = TYPE_MODE (ret_type); + if (INTEGRAL_TYPE_P (ret_type)) + mode = promote_function_mode (ret_type, mode, &unsignedp, fntype_or_decl, 1); + + return gen_rtx_REG (mode, 0); +} + +#undef TARGET_FUNCTION_VALUE +#define TARGET_FUNCTION_VALUE bpf_function_value + +/* Return true if REGNO is th enumber of a hard register in which the + values of called function may come back. */ + +static bool +bpf_function_value_regno_p (const unsigned int regno) +{ + return (regno == 0); +} + +#undef TARGET_FUNCTION_VALUE_REGNO_P +#define TARGET_FUNCTION_VALUE_REGNO_P bpf_function_value_regno_p + +/* Compute the size of the function's stack frame, including the local + area and the register-save area. */ + +static void +bpf_compute_frame (void) +{ + int stack_alignment = STACK_BOUNDARY / BITS_PER_UNIT; + int padding_locals, regno; + + /* Set the space used in the stack by local variables. This is + rounded up to respect the minimum stack alignment. */ + cfun->machine->local_vars_size = get_frame_size (); + + padding_locals = cfun->machine->local_vars_size % stack_alignment; + if (padding_locals) + padding_locals = stack_alignment - padding_locals; + + cfun->machine->local_vars_size += padding_locals; + + /* Set the space used in the stack by callee-saved used registers in + the current function. There is no need to round up, since the + registers are all 8 bytes wide. */ + for (regno = 0; regno < FIRST_PSEUDO_REGISTER; regno++) + if ((!fixed_regs[regno] + && df_regs_ever_live_p (regno) + && !call_used_regs[regno]) + || (cfun->calls_alloca + && regno == STACK_POINTER_REGNUM)) + cfun->machine->callee_saved_reg_size += 8; + + /* Check that the total size of the frame doesn't exceed the limit + imposed by eBPF: currently 512 bytes. */ + if ((cfun->machine->local_vars_size + + cfun->machine->callee_saved_reg_size) > 512) + { + static int stack_limit_exceeded = 0; + + if (!stack_limit_exceeded) + error ("eBPF stack limit of 512 bytes exceeded"); + stack_limit_exceeded = 1; + } +} + +/* Expand to the instructions in a function prologue. This function + is called when expanding the 'prologue' pattern in bpf.md. */ + +void +bpf_expand_prologue (void) +{ + int regno, fp_offset; + rtx insn; + HOST_WIDE_INT size; + + bpf_compute_frame (); + size = (cfun->machine->local_vars_size + + cfun->machine->callee_saved_reg_size); + fp_offset = -cfun->machine->local_vars_size; + + /* Save callee-saved hard registes. The register-save-area starts + right after the local variables. */ + for (regno = 0; regno < FIRST_PSEUDO_REGISTER; regno++) + { + if ((!fixed_regs[regno] + && df_regs_ever_live_p (regno) + && !call_used_regs[regno]) + || (cfun->calls_alloca + && regno == STACK_POINTER_REGNUM)) + { + rtx mem; + + if (!IN_RANGE (fp_offset, -1 - 0x7fff, 0x7fff)) + /* This has been already reported as an error in + bpf_compute_frame. */ + break; + else + { + mem = gen_frame_mem (DImode, + plus_constant (DImode, + gen_rtx_REG (DImode, FRAME_POINTER_REGNUM), + fp_offset - 8)); + insn = emit_move_insn (mem, gen_rtx_REG (DImode, regno)); + RTX_FRAME_RELATED_P (insn) = 1; + fp_offset -= 8; + } + } + } + + /* Set the stack pointer, if the function allocates space + dynamically. Note that the value of %sp should be directly + derived from %fp, for the kernel verifier to track it as a stack + accessor. */ + if (cfun->calls_alloca) + { + insn = emit_move_insn (stack_pointer_rtx, + gen_rtx_REG (DImode, FRAME_POINTER_REGNUM)); + RTX_FRAME_RELATED_P (insn) = 1; + + if (size > 0) + { + insn = emit_insn (gen_rtx_SET (stack_pointer_rtx, + gen_rtx_PLUS (Pmode, + stack_pointer_rtx, + GEN_INT (-size)))); + RTX_FRAME_RELATED_P (insn) = 1; + } + } +} + +/* Expand to the instructions in a function epilogue. This function + is called when expanding the 'prologue' pattern in bpf.md. */ + +void +bpf_expand_epilogue (void) +{ + int regno, fp_offset; + rtx insn; + + bpf_compute_frame (); + fp_offset = -cfun->machine->local_vars_size; + + /* Restore callee-saved hard registes from the stack. */ + for (regno = 0; regno < FIRST_PSEUDO_REGISTER; regno++) + { + if ((!fixed_regs[regno] + && df_regs_ever_live_p (regno) + && !call_used_regs[regno]) + || (cfun->calls_alloca + && regno == STACK_POINTER_REGNUM)) + { + rtx mem; + + if (!IN_RANGE (fp_offset, -1 - 0x7fff, 0x7fff)) + /* This has been already reported as an error in + bpf_compute_frame. */ + break; + else + { + mem = gen_frame_mem (DImode, + plus_constant (DImode, + gen_rtx_REG (DImode, FRAME_POINTER_REGNUM), + fp_offset - 8)); + insn = emit_move_insn (gen_rtx_REG (DImode, regno), mem); + RTX_FRAME_RELATED_P (insn) = 1; + fp_offset -= 8; + } + } + } + + emit_jump_insn (gen_exit ()); +} + +/* Output the extra assembler code for entry to a function. Note this + doesn't generally include instructions, but extra needed + directives. */ + +void +bpf_asm_function_prologue (FILE *file ATTRIBUTE_UNUSED) +{ +} + +#undef TARGET_ASM_FUNCTION_PROLOGUE +#define TARGET_ASM_FUNCTION_PROLOGUE bpf_asm_function_prologue + +/* Output the extra assembler code for exit from a function. */ + +static void +bpf_asm_function_epilogue (FILE *file ATTRIBUTE_UNUSED) +{ +} + +#undef TARGET_ASM_FUNCTION_EPILOGUE +#define TARGET_ASM_FUNCTION_EPILOGUE bpf_asm_function_epilogue + +/* Return the initial difference between the specified pair of + registers. The registers that can figure in FROM, and TO, are + specified by ELIMINABLE_REGS in bpf.h. + + This function is used in the definition of + INITIAL_ELIMINATION_OFFSET in bpf.h */ + +HOST_WIDE_INT +bpf_initial_elimination_offset (int from, + int to) +{ + HOST_WIDE_INT ret; + + if (from == ARG_POINTER_REGNUM && to == STACK_POINTER_REGNUM) + { + bpf_compute_frame (); + ret = (cfun->machine->local_vars_size + + cfun->machine->callee_saved_reg_size); + } + else if (from == ARG_POINTER_REGNUM && to == FRAME_POINTER_REGNUM) + ret = 0; + else + abort (); + + return ret; +} + +/* Return the number of consecutive hard registers, starting at + register number REGNO, required to hold a value of mode MODE. */ + +static unsigned int +bpf_hard_regno_nregs (unsigned int regno ATTRIBUTE_UNUSED, + enum machine_mode mode) +{ + return ((GET_MODE_SIZE (mode) + UNITS_PER_WORD - 1) / UNITS_PER_WORD); +} + +#undef TARGET_HARD_REGNO_NREGS +#define TARGET_HARD_REGNO_NREGS bpf_hard_regno_nregs + +/* Return true if it is permissible to store a value of mode MODE in + hard register number REGNO, or in several registers starting with + that one. */ + +static bool +bpf_hard_regno_mode_ok (unsigned int regno ATTRIBUTE_UNUSED, + enum machine_mode mode) +{ + switch (mode) + { + case E_SImode: + case E_DImode: + case E_HImode: + case E_QImode: + case E_TImode: + case E_SFmode: + case E_DFmode: + return true; + default: + return false; + } +} + +#undef TARGET_HARD_REGNO_MODE_OK +#define TARGET_HARD_REGNO_MODE_OK bpf_hard_regno_mode_ok + +/* Return true if a value of mode MODE1 is accessible in mode MODE2 + without copying. */ + +static bool +bpf_modes_tieable_p (enum machine_mode mode1, + enum machine_mode mode2) +{ + return (mode1 == mode2 + || GET_MODE_CLASS (mode1) == GET_MODE_CLASS (mode2)); +} + +#undef TARGET_MODES_TIEABLE_P +#define TARGET_MODES_TIEABLE_P bpf_modes_tieable_p + +/* Return true if a function must have and use a frame pointer. */ + +static bool +bpf_frame_pointer_required (void) +{ + /* We do not have a stack pointer, so we absolutely depend on the + frame-pointer in order to access the stack... and fishes walk and + pigs fly glglgl */ + return true; +} + +#undef TARGET_FRAME_POINTER_REQUIRED +#define TARGET_FRAME_POINTER_REQUIRED bpf_frame_pointer_required + +/* Return `true' if the given RTX X is a valid base for an indirect + memory access. STRICT has the same meaning than in + bpf_legitimate_address_p. */ + +static inline bool +bpf_address_base_p (rtx x, bool strict) +{ + return (GET_CODE (x) == REG + && (REGNO (x) < 11 + || (!strict && REGNO (x) >= FIRST_PSEUDO_REGISTER))); +} + +/* Return true if X (a RTX) is a legitimate memory address on the + target machine for a memory operand of mode MODE. */ + +static bool +bpf_legitimate_address_p (machine_mode mode ATTRIBUTE_UNUSED, + rtx x, + bool strict) +{ + switch (GET_CODE (x)) + { + case LABEL_REF: + case SYMBOL_REF: + case CONST: + /* These are assumed to fit in 32-bit, because the kernel + imposes a limit to the size of eBPF programs. */ + return true; + break; + + case CONST_INT: + /* This is only valid if the constant fits in a signed + 32-bit. */ + return IN_RANGE (INTVAL (x), -1 - 0x7fffffff, 0x7fffffff); + break; + + case REG: + return bpf_address_base_p (x, strict); + break; + + case PLUS: + { + /* The valid patterns here are: + + (PLUS ADDR_BASE CONST_INT) + (PLUS CONST_INT ADDR_BASE) + + provided CONST_INT fits in a signed 16-bit. + + Note that LABEL_REF and SYMBOL_REF are not allowed in + REG+IMM addresses, because it is almost certain they will + overload the offset field. */ + + rtx x0 = XEXP (x, 0); + rtx x1 = XEXP (x, 1); + + if (bpf_address_base_p (x0, strict) && GET_CODE (x1) == CONST_INT) + return IN_RANGE (INTVAL (x1), -1 - 0x7fff, 0x7fff); + + if (bpf_address_base_p (x1, strict) && GET_CODE (x0) == CONST_INT) + return IN_RANGE (INTVAL (x0), -1 - 0x7fff, 0x7fff); + + break; + } + default: + break; + } + + return false; +} + +#undef TARGET_LEGITIMATE_ADDRESS_P +#define TARGET_LEGITIMATE_ADDRESS_P bpf_legitimate_address_p + +/* Split an out-of-range address displacement into hi and lo parts. + The hi part will have to be loaded into a register separately, but + the low part will be folded into the memory operand. */ + +static bool +bpf_legitimize_address_displacement (rtx *off1, rtx *off2, + poly_int64 poly_offset, machine_mode) +{ + HOST_WIDE_INT orig_offset = poly_offset; + + /* Our case is very easy: the REG part of an indirect address is + 64-bit wide, so it can hold any address. This always leads to + REG+0 */ + + *off1 = GEN_INT (orig_offset); + *off2 = GEN_INT (0); + return true; +} + +#undef TARGET_LEGITIMIZE_ADDRESS_DISPLACEMENT +#define TARGET_LEGITIMIZE_ADDRESS_DISPLACEMENT bpf_legitimize_address_displacement + +/* Return true if memory address ADDR in address space AS can have + different meanings depending on the machine mode of the memory + reference it is used for or if the address is valid for some modes + but not others. */ + +static bool +bpf_mode_dependent_address_p (const_rtx addr ATTRIBUTE_UNUSED, + addr_space_t as ATTRIBUTE_UNUSED) +{ + return true; +} + +#undef TARGET_MODE_DEPENDENT_ADDRESS_P +#define TARGET_MODE_DEPENDENT_ADDRESS_P bpf_mode_dependent_address_p + +/* Return true if X is a legitimate constant for a MODE-mode immediate + operand on the target machine. */ + +static bool +bpf_legitimate_constant_p (enum machine_mode mode ATTRIBUTE_UNUSED, + rtx x ATTRIBUTE_UNUSED) +{ + return true; +} + +#undef TARGET_LEGITIMATE_CONSTANT_P +#define TARGET_LEGITIMATE_CONSTANT_P bpf_legitimate_constant_p + +/* Describe the relative costs of RTL expressions. Return true when + all subexpressions of X have been processed, and false when + `rtx_cost' should recurse. */ + +static bool +bpf_rtx_costs (rtx x ATTRIBUTE_UNUSED, + enum machine_mode mode ATTRIBUTE_UNUSED, + int outer_code ATTRIBUTE_UNUSED, + int opno ATTRIBUTE_UNUSED, + int *total ATTRIBUTE_UNUSED, + bool speed ATTRIBUTE_UNUSED) +{ + /* To be written. */ + return false; +} + +#undef TARGET_RTX_COSTS +#define TARGET_RTX_COSTS bpf_rtx_costs + +/* Return a RTX indicating whether a function argument is passed in a + register and if so, which register. */ + +static rtx +bpf_function_arg (cumulative_args_t ca, enum machine_mode mode ATTRIBUTE_UNUSED, + const_tree type ATTRIBUTE_UNUSED, bool named ATTRIBUTE_UNUSED) +{ + CUMULATIVE_ARGS *cum = get_cumulative_args (ca); + + if (*cum < 5) + return gen_rtx_REG (mode, *cum + 1); + else + /* An error have been emitted for this in + bpf_function_arg_advance. */ + return NULL_RTX; +} + +#undef TARGET_FUNCTION_ARG +#define TARGET_FUNCTION_ARG bpf_function_arg + +/* Update the summarizer variable pointed by CA to advance past an + argument in the argument list. */ + +static void +bpf_function_arg_advance (cumulative_args_t ca, enum machine_mode mode ATTRIBUTE_UNUSED, + const_tree type ATTRIBUTE_UNUSED, bool named ATTRIBUTE_UNUSED) +{ + CUMULATIVE_ARGS *cum = get_cumulative_args (ca); + + if (*cum > 4) + error ("eBPF doesn't support functions with more than 5 arguments"); + (*cum)++; +} + +#undef TARGET_FUNCTION_ARG_ADVANCE +#define TARGET_FUNCTION_ARG_ADVANCE bpf_function_arg_advance + +/* Return true if an argument at the position indicated by CUM should + be passed by reference. If the hook returns true, a copy of that + argument is made in memory and a pointer to the argument is passed + instead of the argument itself. */ + +static bool +bpf_pass_by_reference (cumulative_args_t cum ATTRIBUTE_UNUSED, + enum machine_mode mode, const_tree type, + bool named ATTRIBUTE_UNUSED) +{ + unsigned HOST_WIDE_INT size; + + if (type) + { + if (AGGREGATE_TYPE_P (type)) + return true; + size = int_size_in_bytes (type); + } + else + size = GET_MODE_SIZE (mode); + + return (size > 8*5); +} + +#undef TARGET_PASS_BY_REFERENCE +#define TARGET_PASS_BY_REFERENCE bpf_pass_by_reference + +/* Diagnostics on function contents. */ + +static void +bpf_set_current_function (tree decl) +{ + if (decl == NULL_TREE + || current_function_decl == NULL_TREE + || current_function_decl == error_mark_node + || !cfun->machine + || cfun->machine->diagnostics_checked_p) + return; + + /* Currently we don't do anything meaningful here. To be + changed. */ + + /* Don't print the above diagnostics more than once. */ + cfun->machine->diagnostics_checked_p = 1; +} + +#undef TARGET_SET_CURRENT_FUNCTION +#define TARGET_SET_CURRENT_FUNCTION bpf_set_current_function + +/* Output the assembly code for a constructor. Since eBPF doesn't + support indirect calls, constructors are not supported. */ + +static void +bpf_output_constructor (rtx symbol, int priority ATTRIBUTE_UNUSED) +{ + fatal_insn ("no support for constructors sorry", symbol); +} + +#undef TARGET_ASM_CONSTRUCTOR +#define TARGET_ASM_CONSTRUCTOR bpf_output_constructor + +/* Output the assembly code for a destructor. Since eBPF doesn't + support indirect calls, destructors are not supported. */ + +static void +bpf_output_destructor (rtx symbol, int priority ATTRIBUTE_UNUSED) +{ + fatal_insn ("no support for destructors sorry", symbol); +} + +#undef TARGET_ASM_DESTRUCTOR +#define TARGET_ASM_DESTRUCTOR bpf_output_destructor + +/* Return the appropriate instruction to CALL to a function. TARGET + is a `mem' RTX denoting the address of the called function. + + The main purposes of this function are: + - To reject indirect CALL instructions, which are not supported by + eBPf. + - To recognize calls to kernel helper functions and emit the + corresponding CALL N instruction. + + This function is called from the expansion of the 'call' pattern in + bpf.md. */ + +const char * +bpf_output_call (rtx target) +{ + static char *insn; + rtx op; + + op = XEXP (target, 0); + switch (GET_CODE (op)) + { + case CONST_INT: + insn = (char *) xmalloc (5 + 6 + 1); + sprintf (insn, "call\t%ld", INTVAL (op)); + break; + case SYMBOL_REF: + { + const char *function_name = XSTR (op, 0); + int code; + + if (strncmp (function_name, "__builtin_bpf_helper_", 21) == 0 + && ((code = bpf_helper_code (function_name + 21)) != 0)) + { + insn = (char *) xmalloc (5 + 6 + 1); + sprintf (insn, "call\t%d", code); + } + else + { + insn = (char *) xmalloc (strlen (function_name) + 5 + 1); + sprintf (insn, "call\t%s", function_name); + } + break; + } + default: + error ("indirect call in function, which are not supported by eBPF"); + insn = xstrdup ("call 0"); + break; + } + + return insn; +} + +/* Print an instruction operand. This function is called in the macro + PRINT_OPERAND defined in bpf.h */ + +void +bpf_print_operand (FILE *file, rtx op, int code ATTRIBUTE_UNUSED) +{ + switch (GET_CODE (op)) + { + case REG: + fprintf (file, "%s", reg_names[REGNO (op)]); + break; + case MEM: + output_address (GET_MODE (op), XEXP (op, 0)); + break; + case CONST_DOUBLE: + if (CONST_DOUBLE_HIGH (op)) + fprintf (file, HOST_WIDE_INT_PRINT_DOUBLE_HEX, + CONST_DOUBLE_HIGH (op), CONST_DOUBLE_LOW (op)); + else if (CONST_DOUBLE_LOW (op) < 0) + fprintf (file, HOST_WIDE_INT_PRINT_HEX, CONST_DOUBLE_LOW (op)); + else + fprintf (file, HOST_WIDE_INT_PRINT_DEC, CONST_DOUBLE_LOW (op)); + break; + case LABEL_REF: + /* This is for label values. */ + /* Fallthrough. */ + default: + output_addr_const (file, op); + } +} + +/* Print an operand which is an address. This function should handle + any legit address, as accepted by bpf_legitimate_address_p. + + This function is called in the PRINT_OPERAND_ADDRESS macro defined + in bpf.h */ + +void +bpf_print_operand_address (FILE *file, rtx addr) +{ + switch (GET_CODE (addr)) + { + case REG: + fprintf (file, "[%s+0]", reg_names[REGNO (addr)]); + break; + case PLUS: + { + rtx op0 = XEXP (addr, 0); + rtx op1 = XEXP (addr, 1); + + if (GET_CODE (op0) == REG && CONSTANT_ADDRESS_P (op1)) + { + fprintf (file, "[%s+", reg_names[REGNO (op0)]); + output_addr_const (file, op1); + fputs ("]", file); + } + else if (GET_CODE (op1) == REG && CONSTANT_ADDRESS_P (op0)) + { + fprintf (file, "[%s+", reg_names[REGNO (op1)]); + output_addr_const (file, op0); + fputs ("]", file); + } + else + fatal_insn ("invalid address in operand", addr); + break; + } + case MEM: + /* Fallthrough. */ + case LABEL_REF: + /* Fallthrough. */ + fatal_insn ("unsupported operand", addr); + break; + default: + output_addr_const (file, addr); + break; + } +} + +/* Add a BPF builtin function with NAME, CODE and TYPE. Return + the function decl or NULL_TREE if the builtin was not added. */ + +static tree +def_builtin (const char *name, enum bpf_builtins code, tree type) +{ + tree t + = add_builtin_function (name, type, code, BUILT_IN_MD, NULL, NULL_TREE); + + if (t) + bpf_builtins[code] = t; + + return t; +} + +/* Define machine-specific built-in functions. */ + +static void +bpf_init_builtins (void) +{ + /* Built-ins for calling kernel helpers. */ + + tree pt = build_pointer_type (void_type_node); + tree const_void_type + = build_qualified_type (void_type_node, TYPE_QUAL_CONST); + tree cpt = build_pointer_type (const_void_type); + tree st = short_integer_type_node; + tree ust = uint16_type_node; + tree it = integer_type_node; + tree ut = unsigned_type_node; + tree const_char_type + = build_qualified_type (char_type_node, TYPE_QUAL_CONST); + tree cst = build_pointer_type (const_char_type); + tree vt = void_type_node; + tree ult = long_unsigned_type_node; + tree u32t = uint32_type_node; + tree u64t = uint64_type_node; + tree llt = long_long_integer_type_node; + tree ullt = long_long_unsigned_type_node; + +#define TYPES build_function_type_list +#define VTYPES build_varargs_function_type_list +#define DEF_HELPER(V,D,N,T) \ + do \ + { \ + if (bpf_kernel >= (V)) \ + def_builtin ("__builtin_bpf_helper_" #N, \ + BPF_BUILTIN_HELPER_##D, \ + T); \ + } while (0); +# include "bpf-helpers.def" +#undef TYPES +#undef VTYPES +#undef DEF_HELPER + + /* Built-ins for BPF_LD_ABS and BPF_LD_IND instructions. */ + + def_builtin ("__builtin_bpf_load_byte", BPF_BUILTIN_LOAD_BYTE, + build_function_type_list (ullt, ullt, 0)); + def_builtin ("__builtin_bpf_load_half", BPF_BUILTIN_LOAD_HALF, + build_function_type_list (ullt, ullt, 0)); + def_builtin ("__builtin_bpf_load_word", BPF_BUILTIN_LOAD_WORD, + build_function_type_list (ullt, ullt, 0)); +} + +#undef TARGET_INIT_BUILTINS +#define TARGET_INIT_BUILTINS bpf_init_builtins + +/* Expand a call to a BPF-specific built-in function that was set up + with bpf_init_builtins. */ + +static rtx +bpf_expand_builtin (tree exp, rtx target, + rtx subtarget ATTRIBUTE_UNUSED, + machine_mode mode ATTRIBUTE_UNUSED, + int ignore) +{ + tree fndecl = TREE_OPERAND (CALL_EXPR_FN (exp), 0); + int code = DECL_MD_FUNCTION_CODE (fndecl); + + if (code >= 1 && code < BPF_BUILTIN_HELPER_MAX) + { + /* This is a builtin to call a kernel helper function. + + For these builtins, we just expand the function call normally + with expand_call like we would do for a libcall. The function + bpf_output_call below will then do The Right Thing (TM), + recognizing the name of the called __builtin_helper_* symbol + and emitting the corresponding CALL N instruction whenever + necessary. */ + + return expand_call (exp, target, ignore); + } + else if (code == BPF_BUILTIN_LOAD_BYTE + || code == BPF_BUILTIN_LOAD_HALF + || code == BPF_BUILTIN_LOAD_WORD) + { + /* Expand an indirect load from the sk_buff in the context. + There is just one argument to the builtin, which is the + offset. + + We try first to expand a ldabs* instruction. In case this + fails, we try a ldind* instruction. */ + + enum insn_code abs_icode + = (code == BPF_BUILTIN_LOAD_BYTE ? CODE_FOR_ldabsb + : code == BPF_BUILTIN_LOAD_HALF ? CODE_FOR_ldabsh + : CODE_FOR_ldabsw); + + enum insn_code ind_icode + = (code == BPF_BUILTIN_LOAD_BYTE ? CODE_FOR_ldindb + : code == BPF_BUILTIN_LOAD_HALF ? CODE_FOR_ldindh + : CODE_FOR_ldindw); + + tree offset_arg = CALL_EXPR_ARG (exp, 0); + struct expand_operand ops[2]; + + create_input_operand (&ops[0], expand_normal (offset_arg), + TYPE_MODE (TREE_TYPE (offset_arg))); + create_input_operand (&ops[1], gen_rtx_CONST_INT (SImode, 0), + SImode); + + if (!maybe_expand_insn (abs_icode, 2, ops) + && !maybe_expand_insn (ind_icode, 2, ops)) + { + error ("invalid argument to built-in function"); + return gen_rtx_REG (ops[0].mode, 0); + } + + /* The result of the load is in R0. */ + return gen_rtx_REG (ops[0].mode, 0); + } + + gcc_unreachable (); +} + +#undef TARGET_EXPAND_BUILTIN +#define TARGET_EXPAND_BUILTIN bpf_expand_builtin + +/* Initialize target-specific function library calls. This is mainly + used to call library-provided soft-fp operations, since eBPF + doesn't support floating-point in "hardware". */ + +static void +bpf_init_libfuncs (void) +{ + set_conv_libfunc (sext_optab, DFmode, SFmode, + "__bpf_extendsfdf2"); + set_conv_libfunc (trunc_optab, SFmode, DFmode, + "__bpf_truncdfsf2"); + set_conv_libfunc (sfix_optab, SImode, DFmode, + "__bpf_fix_truncdfsi"); + set_conv_libfunc (sfloat_optab, DFmode, SImode, + "__bpf_floatsidf"); + set_conv_libfunc (ufloat_optab, DFmode, SImode, + "__bpf_floatunsidf"); +} + +#undef TARGET_INIT_LIBFUNCS +#define TARGET_INIT_LIBFUNCS bpf_init_libfuncs + +/* Define the mechanism that will be used for describing frame unwind + information to the debugger. In eBPF it is not possible to unwind + frames. */ + +static enum unwind_info_type +bpf_debug_unwind_info () +{ + return UI_NONE; +} + +#undef TARGET_DEBUG_UNWIND_INFO +#define TARGET_DEBUG_UNWIND_INFO bpf_debug_unwind_info + +/* Always promote arguments and return values in function calls. */ + +#undef TARGET_PROMOTE_FUNCTION_MODE +#define TARGET_PROMOTE_FUNCTION_MODE default_promote_function_mode_always_promote + +/* Output assembly directives to assemble data of various sized and + alignments. */ + +#undef TARGET_ASM_BYTE_OP +#define TARGET_ASM_BYTE_OP "\t.byte\t" +#undef TARGET_ASM_ALIGNED_HI_OP +#define TARGET_ASM_ALIGNED_HI_OP "\t.half\t" +#undef TARGET_ASM_ALIGNED_SI_OP +#define TARGET_ASM_ALIGNED_SI_OP "\t.word\t" +#undef TARGET_ASM_ALIGNED_DI_OP +#define TARGET_ASM_ALIGNED_DI_OP "\t.dword\t" + +/* Finally, build the GCC target. */ + +struct gcc_target targetm = TARGET_INITIALIZER; + +#include "gt-bpf.h" diff --git a/gcc/config/bpf/bpf.h b/gcc/config/bpf/bpf.h new file mode 100644 index 00000000000..038542b5e22 --- /dev/null +++ b/gcc/config/bpf/bpf.h @@ -0,0 +1,565 @@ +/* Definition of the eBPF target for GCC. + Copyright (C) 2019 Free Software Foundation, Inc. + + This file is part of GCC. + + GCC is free software; you can redistribute it and/or modify it + under the terms of the GNU General Public License as published by + the Free Software Foundation; either version 3, or (at your option) + any later version. + + GCC is distributed in the hope that it will be useful, but WITHOUT + ANY WARRANTY; without even the implied warranty of MERCHANTABILITY + or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public + License for more details. + + You should have received a copy of the GNU General Public License + along with GCC; see the file COPYING3. If not see + . */ + +#ifndef GCC_BPF_H +#define GCC_BPF_H + +/**** Controlling the Compilation Driver. */ + +#define ASM_SPEC "%{mbig-endian:-EB} %{mlittle-endian:-EL}" +#define LINK_SPEC "%{mbig-endian:-EB} %{mlittle-endian:-EL}" +#define LIB_SPEC "" +#define STARTFILE_SPEC "" + +/**** Run-time Target Specification. */ + +#define TARGET_CPU_CPP_BUILTINS() bpf_target_macros (pfile) + +/**** Storage Layout. */ + +/* Endianness and word size. */ +#define BITS_BIG_ENDIAN 0 +#define BYTES_BIG_ENDIAN (!TARGET_LITTLE_ENDIAN) +#define WORDS_BIG_ENDIAN (!TARGET_LITTLE_ENDIAN) +#define BITS_PER_WORD 64 +#define UNITS_PER_WORD 8 + +/* This should not be needed, because ptr_mode, Pmode and word_mode + are all the same width. */ +#define POINTERS_EXTEND_UNSIGNED 1 + +/* When storing an integer whose size is less than 64-bit in a + register, promote it to a DImode. */ +#define PROMOTE_MODE(M, UNSIGNEDP, TYPE) \ + do \ + { \ + if (GET_MODE_CLASS (M) == MODE_INT \ + && GET_MODE_SIZE (M) < 8) \ + M = DImode; \ + } while (0) + +/* Biggest alignment supported by the object file format of this + machine. In this case this is ELF. Use the same definition than + in elfos.h */ +#define MAX_OFILE_ALIGNMENT (((unsigned int) 1 << 28) * 8) + +/* Align argument parameters on the stack to 64-bit, at a minimum. */ +#define PARM_BOUNDARY 64 + +/* The hardware enforces that the stack pointer should be aligned to + 64-bit at any time. */ +#define STACK_BOUNDARY 64 + +/* Function entry points are aligned to 128 bits. */ +#define FUNCTION_BOUNDARY 128 + +/* Maximum alignment required by data of any type. */ +#define BIGGEST_ALIGNMENT 64 + +/* The load and store instructions won't work if the data is not in + it's expected alignment. */ +#define STRICT_ALIGNMENT 1 + +/* We use Pmode as the mode of the size increment operand in an + `allocate_stack' pattern. */ +#define STACK_SIZE_MODE Pmode + +/**** Layout of Source Language Data Types. */ + +#define INT_TYPE_SIZE 32 +#define SHORT_TYPE_SIZE 16 +#define LONG_TYPE_SIZE 64 +#define LONG_LONG_TYPE_SIZE 64 +#define CHAR_TYPE_SIZE 8 +#define FLOAT_TYPE_SIZE 32 +#define DOUBLE_TYPE_SIZE 64 +#define LONG_DOUBLE_TYPE_SIZE 64 + +#define INTPTR_TYPE "long int" +#define UINTPTR_TYPE "long unsigned int" +#define SIZE_TYPE "long unsigned int" +#define PTRDIFF_TYPE "long int" + +#define SIG_ATOMIC_TYPE "char" + +#define INT8_TYPE "char" +#define INT16_TYPE "short int" +#define INT32_TYPE "int" +#define INT64_TYPE "long int" +#define UINT8_TYPE "unsigned char" +#define UINT16_TYPE "short unsigned int" +#define UINT32_TYPE "unsigned int" +#define UINT64_TYPE "long unsigned int" + +#define INT_LEAST8_TYPE INT8_TYPE +#define INT_LEAST16_TYPE INT16_TYPE +#define INT_LEAST32_TYPE INT32_TYPE +#define INT_LEAST64_TYPE INT64_TYPE +#define UINT_LEAST8_TYPE UINT8_TYPE +#define UINT_LEAST16_TYPE UINT16_TYPE +#define UINT_LEAST32_TYPE UINT32_TYPE +#define UINT_LEAST64_TYPE UINT64_TYPE + +#define INT_FAST8_TYPE INT8_TYPE +#define INT_FAST16_TYPE INT16_TYPE +#define INT_FAST32_TYPE INT32_TYPE +#define INT_FAST64_TYPE INT64_TYPE +#define UINT_FAST8_TYPE UINT8_TYPE +#define UINT_FAST16_TYPE UINT16_TYPE +#define UINT_FAST32_TYPE UINT32_TYPE +#define UINT_FAST64_TYPE UINT64_TYPE + +/* `char' is signed by default, like in x86. */ +#define DEFAULT_SIGNED_CHAR 1 + +/* The widest floating-point format supported by the hardware is + 64-bit. */ +#define WIDEST_HARDWARE_FP_SIZE 64 + +/* `wchar_t' is a signed 32-bit type. The second constant is used by + cpp, which can't use WCHAR_TYPE. */ +#define WCHAR_TYPE "int" +#define WCHAR_TYPE_SIZE 32 + +/* `wint_t' is a signed 32-bit type. */ +#define WINT_TYPE "int" +#define WINT_TYPE_SIZE 32 + +/**** Register Usage. */ + +/*** Basic Characteristics of Registers. */ + +#define BPF_R0 0 +#define BPF_R1 1 +#define BPF_R2 2 +#define BPF_R3 3 +#define BPF_R4 4 +#define BPF_R5 5 +#define BPF_R6 6 +#define BPF_CTX BPF_R6 +#define BPF_R7 7 +#define BPF_R8 8 +#define BPF_R9 9 +#define BPF_SP BPF_R9 +#define BPF_R10 10 +#define BPF_FP BPF_R10 +/* 11 is not a real eBPF hard register and is eliminated or not used + in the final assembler. See below. */ + +#define FIRST_PSEUDO_REGISTER 12 + +/* The registers %r0..%r8 are available for general allocation. */ +#define FIXED_REGISTERS \ + {0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 1, 1} + +/* %r0..%r5 are clobbered by function calls. */ +#define CALL_USED_REGISTERS \ + {1, 1, 1, 1, 1, 1, 0, 0, 0, 1, 1, 1} + +/*** Order of Allocation of Registers. */ + +/* We generally want to put call-clobbered registers ahead of + call-saved ones. (IRA expects this.) */ +#define REG_ALLOC_ORDER \ + {0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11} + +/**** Register Classes. */ + +enum reg_class +{ + NO_REGS, /* no registers in set. */ + GR_REGS, /* general-purpose integer registers. */ + ALL_REGS, /* all registers. */ + LIM_REG_CLASSES /* max value + 1. */ +}; + +#define N_REG_CLASSES (int) LIM_REG_CLASSES +#define GENERAL_REGS GR_REGS + +/* An initializer containing the names of the register classes as C + string constants. These names are used in writing some of the + debugging dumps. */ +#define REG_CLASS_NAMES \ +{ \ + "NO_REGS", \ + "GR_REGS", \ + "ALL_REGS" \ +} + +/* An initializer containing the contents of the register classes, as + integers which are bit masks. The Nth integer specifies the + contents of class N. The way the integer MASK is interpreted is + that register R is in the class if `MASK & (1 << R)' is 1. */ +#define REG_CLASS_CONTENTS \ +{ \ + 0x00000000, /* NO_REGS */ \ + 0x000007ff, /* GR_REGS */ \ + 0x000007ff, /* ALL_REGS */ \ +} + +/* A C expression whose value is a register class containing hard + register REGNO. In general there is more that one such class; + choose a class which is "minimal", meaning that no smaller class + also contains the register. */ +#define REGNO_REG_CLASS(REGNO) ((REGNO) < 11 ? GR_REGS : ALL_REGS) + +/* A macro whose definition is the name of the class to which a + valid base register must belong. A base register is one used in + an address which is the register value plus a displacement. */ +#define BASE_REG_CLASS GR_REGS + +/* A macro whose definition is the name of the class to which a + valid index register must belong. An index register is one used + in an address where its value is either multiplied by a scale + factor or added to another register (as well as added to a + displacement). */ +#define INDEX_REG_CLASS GR_REGS + +/* C expression which is nonzero if register number REGNO is suitable + for use as a base register in operand addresses. In eBPF every + hard register can be used for this purpose. */ +#define REGNO_OK_FOR_BASE_P(REGNO) \ + ((REGNO) < FIRST_PSEUDO_REGISTER \ + || (unsigned)reg_renumber[REGNO] < FIRST_PSEUDO_REGISTER) + +/* C expression which is nonzero if register number REGNO is suitable + for use as an index register in operand addresses. */ +#define REGNO_OK_FOR_INDEX_P(REGNO) \ + REGNO_OK_FOR_BASE_P(REGNO) + +/* It is safe to return CLASS here. No more restrictive class is + needed. */ +#define PREFERRED_RELOAD_CLASS(X,CLASS) CLASS + +/* Maximum number of consecutive registers of class CLASS needed to + hold a value of mode MODE. */ +#define CLASS_MAX_NREGS(CLASS, MODE) \ + (((GET_MODE_SIZE (MODE) + UNITS_PER_WORD - 1) / UNITS_PER_WORD)) + + +/**** Debugging Info ****/ + +/* We cannot support DWARF2 because of the limitations of eBPF. */ +#define DBX_DEBUGGING_INFO + +/**** Stack Layout and Calling Conventions. */ + +/*** Basic Stack Layout. */ + +#define STACK_GROWS_DOWNWARD 1 +#define FRAME_GROWS_DOWNWARD 1 + +/* The argument pointer always points to the first argument. */ +#define FIRST_PARM_OFFSET(FNDECL) 0 + +/* Unsupported. */ +#define RETURN_ADDR_RTX(count, frame) const0_rtx + +/*** Registers That Address the Stack Frame. */ + +#define FRAME_POINTER_REGNUM 10 +#define STACK_POINTER_REGNUM 9 +#define ARG_POINTER_REGNUM 11 +#define STATIC_CHAIN_REGNUM 8 + +/*** Registers elimination. */ + +#define ELIMINABLE_REGS \ + {{ ARG_POINTER_REGNUM, FRAME_POINTER_REGNUM }, \ + { ARG_POINTER_REGNUM, STACK_POINTER_REGNUM }} + +/* Define the offset between two registers, one to be eliminated, and + the other its replacement, at the start of a routine. */ +#define INITIAL_ELIMINATION_OFFSET(FROM, TO, OFFSET) \ + do \ + { \ + (OFFSET) = bpf_initial_elimination_offset ((FROM), (TO)); \ + } while (0) + +/*** Passing Function Arguments on the Stack. */ + +/* The eBPF ABI doesn't support passing arguments on the stack. Only + in the first five registers. Code in bpf.c assures the stack is + never used when passing arguments. However, we still have to + define the constants below. */ + +/* If nonzero, push insns will be used to pass outgoing arguments. */ +#define PUSH_ARGS 0 + +/* If nonzero, function arguments will be evaluated from last to + first, rather than from first to last. */ +#define PUSH_ARGS_REVERSED 1 + +/* Allocate stack space for arguments at the beginning of each + function. */ +#define ACCUMULATE_OUTGOING_ARGS 1 + +/*** Passing Arguments in Registers. */ + +/* Use an integer in order to keep track of the number of arguments + passed to a function in integer registers, up to + MAX_ARGS_IN_REGISTERS. */ +#define CUMULATIVE_ARGS int + +/* INIT_CUMULATIVE_ARGS initializes a variable CUM of type + CUMULATIVE_ARGS for a call to a function whose data type is FNTYPE. + For a library call, FNTYPE is 0. */ +#define INIT_CUMULATIVE_ARGS(CUM,FNTYPE,LIBNAME,FNDECL,N_NAMED_ARGS) \ + memset (&(CUM), 0, sizeof (CUM)) + +/* Nonzero if N is the number of a hard register in which function + arguments are sometimes passed. */ +#define FUNCTION_ARG_REGNO_P(N) ((N) >= 1 && (N) <= 5) + +/*** How Scalar Function Values are Returned. */ + +/* Define how to find the value returned by a library function + assuming the value has mode MODE. This is always %r0 for eBPF. */ +#define LIBCALL_VALUE(MODE) \ + gen_rtx_REG ((MODE), 0) + +/*** Generating Code for Profiling. */ + +/* We do not support profiling yet, so do not call `mcount'. */ +#define FUNCTION_PROFILER(FILE, LABELNO) do { } while (0) + +/*** Function Entry and Exit. */ + +/* We do not require an accurate stack pointer at function return. + This is because the stack pointer's original value is initialized + from the frame pointer, rather than decreased, to satisfy the + kernel's verifier. Thus, we have to save the stack pointer in + function prologue and restore it in function epilogue. If + EXIT_IGNORE_STACK is not set, then superfluous instructions are + generated to save and restore the stack pointer after and before + the function epilogue, respectively. */ +#define EXIT_IGNORE_STACK 1 + +/**** Support for Nested Functions. */ + +/* We have to define TRAMPOLINE_SIZE even if we don't ever generate + them. Set to 64 arbitrarily. */ +#define TRAMPOLINE_SIZE 64 + +/**** Addressing Modes. */ + +/* Maximum number of registers that can appear in a valid memory + address. */ +#define MAX_REGS_PER_ADDRESS 1 + +/* 1 if X is an rtx for a constant that is a valid address. */ + +#define CONSTANT_ADDRESS_P(X) \ + (GET_CODE (X) == LABEL_REF || GET_CODE (X) == SYMBOL_REF \ + || GET_CODE (X) == CONST_INT || GET_CODE (X) == CONST) + +/**** Describing Relative Costs of Operations. */ + +/* Cost of moving data of mode MODE from a register in class FROM to a + register in class TO. Note that 2 is the default. */ +#define REGISTER_MOVE_COST(MODE,FROM,TO) 2 + +/* Cost of moving data of mode MODE between a register of class CLASS + and memory. IN is zero if the value is to be written to memory, + nonzero if it is to be read in. */ +#define MEMORY_MOVE_COST(MODE,CLASS,IN) 4 + +/* Cost of a branch instruction. A value of 1 is the default. */ +#define BRANCH_COST(SPEED_P,PREDICTABLE_P) 1 + +/* The SPARC port says: Nonzero if access to memory by bytes is slow + and undesirable. For RISC chips, it means that access to memory by + bytes is no better than access by words when possible, so grab a + whole word and maybe make use of that. */ +#define SLOW_BYTE_ACCESS 1 + +/* Threshold of number of scalar memory-to-memory move instructions, + _below_ which a sequence of insns should be generated instead of a + string move insn or a library call. */ +#define MOVE_RATIO(speed) 128 + +/* Threshold of number of scalar move instructions, _below_ which a + sequence of insns should be generated to clear memory instead of a + string clear insn or a library call. */ +#define CLEAR_RATIO(speed) 128 + +/* Threshold of number of scalar move instructions, _below_ which a + sequence of insns should be generated to set memory to a constant + value, instead of a block set insn or a library call. */ +#define SET_RATIO(speed) 128 + +/* True if it is as good or better to call a constant function address + than to call an address kept in a register. */ +#define NO_FUNCTION_CSE 1 + +/**** Dividing the Output into Sections. */ + +#define TEXT_SECTION_ASM_OP "\t.text" +#define DATA_SECTION_ASM_OP "\t.data" +#define BSS_SECTION_ASM_OP "\t.bss" +#define COMMON_ASM_OP "\t.common\t" + +/**** Defining the Output Assembler Language. */ + +/*** The Overall Framework of an Assembler File. */ + +#define ASM_COMMENT_START ";" + +/* Output to assembler file text saying following lines + may contain character constants, extra white space, comments, etc. */ + +#ifndef ASM_APP_ON +#define ASM_APP_ON " #APP\n" +#endif + +/* Output to assembler file text saying following lines + no longer contain unusual constructs. */ + +#ifndef ASM_APP_OFF +#define ASM_APP_OFF " #NO_APP\n" +#endif + +/*** Output of Data. */ + +/*** Output of Uninitialized Variables. */ + +/* How to output an assembler line to define a local common + symbol. */ + +#define ASM_OUTPUT_ALIGNED_COMMON(FILE, NAME, SIZE, ALIGN) \ + do \ + { \ + fprintf ((FILE), "%s", COMMON_ASM_OP); \ + assemble_name ((FILE), (NAME)); \ + fprintf ((FILE), ",%u,%u\n", (int)(SIZE), (ALIGN) / (BITS_PER_UNIT)); \ + } \ + while (0) + +/* A C statement (sans semicolon) to output to the stdio stream + FILE the assembler definition of uninitialized global DECL named + NAME whose size is SIZE bytes and alignment is ALIGN bytes. + Try to use asm_output_aligned_bss to implement this macro. */ + +#define ASM_OUTPUT_ALIGNED_BSS(FILE, DECL, NAME, SIZE, ALIGN) \ + do { \ + ASM_OUTPUT_ALIGNED_LOCAL (FILE, NAME, SIZE, ALIGN); \ + } while (0) + +/* This says how to output an assembler line to define a local common + symbol. */ + +#define ASM_OUTPUT_ALIGNED_LOCAL(FILE,NAME,SIZE,ALIGN) \ + ( fputs ("\t.lcomm ", (FILE)), \ + assemble_name ((FILE), (NAME)), \ + fprintf ((FILE), "," HOST_WIDE_INT_PRINT_UNSIGNED "\n", \ + (SIZE), ((ALIGN) / BITS_PER_UNIT))) + +/*** Output and Generation of Labels. */ + +/* Globalizing directive for a label. */ +#define GLOBAL_ASM_OP "\t.global\t" + +/* This is how to store into the string LABEL + the symbol_ref name of an internal numbered label where + PREFIX is the class of label and NUM is the number within the class. + This is suitable for output with `assemble_name'. */ + +#undef ASM_GENERATE_INTERNAL_LABEL +#define ASM_GENERATE_INTERNAL_LABEL(LABEL,PREFIX,NUM) \ + sprintf ((LABEL), "*%s%s%ld", (LOCAL_LABEL_PREFIX), (PREFIX), (long)(NUM)) + +/*** Macros Controlling Initialization Routines. */ + +#define INIT_SECTION_ASM_OP "\t.init" +#define FINI_SECTION_ASM_OP "\t.fini" + +/*** Output of Assembler Instructions. */ + +#define REGISTER_NAMES \ + { "%r0", "%r1", "%r2", "%r3", "%r4", "%r5", "%r6", "%r7", \ + "%r8", "%r9", "%fp", "__arg__" } + +#define ADDITIONAL_REGISTER_NAMES \ + { { "%a", 0 }, { "%ctx", 6 }, { "%r10" , 10 } } + +#define LOCAL_LABEL_PREFIX "." +#define USER_LABEL_PREFIX "" + +#define PRINT_OPERAND(STREAM,X,CODE) \ + bpf_print_operand ((STREAM),(X),(CODE)) + +#define PRINT_OPERAND_ADDRESS(STREAM,X) \ + bpf_print_operand_address ((STREAM), (X)) + +/*** Assembler Commands for Alignment. */ + +/* This is how to output an assembler line that says to advance the + location counter to a multiple of 2**LOG bytes. */ +#define ASM_OUTPUT_ALIGN(STREAM,LOG) \ + fprintf (STREAM, "\t.align\t%d\n", (LOG)) + +/* This is how to output an assembler line + that says to advance the location counter by SIZE bytes. */ +#define ASM_OUTPUT_SKIP(FILE,SIZE) \ + fprintf (FILE, "\t.skip\t" HOST_WIDE_INT_PRINT_UNSIGNED "\n", (SIZE)) + +/**** Miscellaneous Parameters. */ + +/* Specify the machine mode that this machine uses for the index in + the tablejump instruction. */ +#define CASE_VECTOR_MODE DImode + +/* Define if operations between registers with integral mode smaller + than a word are always performed on the entire register. */ +#define WORD_REGISTER_OPERATIONS 1 + +/* C expression indicating when insns that read memory in MEM_MODE, an + integral mode narrower than a word, set the bits outsize of + MEM_MODE to be either the sign-extension or the zero-extension of + the data read. */ +#define LOAD_EXTEND_OP(MODE) ZERO_EXTEND + +/* The maximum number of bytes that a signle instruction can move + quickly between memory and registers or between two memory + locations. */ +#define MOVE_MAX 8 + +/* An alias for the machine mode for pointers. */ +#define Pmode DImode + +/* An alias for the machine mode used for memory references to + functions being called, in 'call' RTL expressions. */ +#define FUNCTION_MODE Pmode + +/* No libm on eBPF (for now.) */ +#define MATH_LIBRARY "" + +/**** libgcc settings. */ + +/* Iterating over the global constructors and destructors and + executing them requires the ability of doing indirect calls. + + eBPF doesn't support indirect calls, so no chance of supporting + constructors and destructors. */ +#define DO_GLOBAL_CTORS_BODY \ + do { } while (0) +#define DO_GLOBAL_DTORS_BODY \ + do { } while (0) + +#endif /* ! GCC_BPF_H */ diff --git a/gcc/config/bpf/bpf.md b/gcc/config/bpf/bpf.md new file mode 100644 index 00000000000..6954a438c20 --- /dev/null +++ b/gcc/config/bpf/bpf.md @@ -0,0 +1,528 @@ +;; Machine description for eBPF. +;; Copyright (C) 2019 Free Software Foundation, Inc. + +;; This file is part of GCC. + +;; GCC is free software; you can redistribute it and/or modify +;; it under the terms of the GNU General Public License as published by +;; the Free Software Foundation; either version 3, or (at your option) +;; any later version. + +;; GCC is distributed in the hope that it will be useful, +;; but WITHOUT ANY WARRANTY; without even the implied warranty of +;; MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the +;; GNU General Public License for more details. + +;; You should have received a copy of the GNU General Public License +;; along with GCC; see the file COPYING3. If not see +;; . + +(include "predicates.md") +(include "constraints.md") + +;;;; Unspecs + +(define_c_enum "unspec" [ + UNSPEC_LDINDABS + UNSPEC_XADD +]) + +;;;; Constants + +(define_constants + [(R0_REGNUM 0) + (R1_REGNUM 1) + (R2_REGNUM 2) + (R3_REGNUM 3) + (R4_REGNUM 4) + (R5_REGNUM 5) + (R6_REGNUM 6) + (R7_REGNUM 7) + (R8_REGNUM 8) + (R9_REGNUM 9) + (R10_REGNUM 10) + (R11_REGNUM 11) +]) + +;;;; Attributes + +;; Instruction classes. +;; alu 64-bit arithmetic. +;; alu32 32-bit arithmetic. +;; end endianness conversion instructions. +;; ld load instructions. +;; lddx load 64-bit immediate instruction. +;; ldx generic load instructions. +;; st generic store instructions for immediates. +;; stx generic store instructions. +;; jmp jump instructions. +;; xadd atomic exchange-and-add instructions. +;; multi multiword sequence (or user asm statements). + +(define_attr "type" + "unknown,alu,alu32,end,ld,lddw,ldx,st,stx,jmp,xadd,multi" + (const_string "unknown")) + +;; Length of instruction in bytes. +(define_attr "length" "" + (cond [ + (eq_attr "type" "lddw") (const_int 16) + ] (const_int 8))) + +;; Describe a user's asm statement. +(define_asm_attributes + [(set_attr "type" "multi")]) + +;;;; Mode attributes and iterators + +(define_mode_attr mop [(QI "b") (HI "h") (SI "w") (DI "dw") + (SF "w") (DF "dw")]) +(define_mode_attr mtype [(SI "alu32") (DI "alu")]) +(define_mode_attr msuffix [(SI "32") (DI "")]) + +;;;; NOPs + +(define_insn "nop" + [(const_int 0)] + "" + "mov\t%%r0,%%r0" + [(set_attr "type" "alu")]) + +;;;; Arithmetic/Logical + +;; The arithmetic and logic operations below are defined for SI and DI +;; modes. The mode iterator AM is used in order to expand to two +;; insns, with the proper modes. +;; +;; 32-bit arithmetic (for SI modes) is implemented using the alu32 +;; instructions. + +(define_mode_iterator AM [SI DI]) + +;;; Addition +(define_insn "add3" + [(set (match_operand:AM 0 "register_operand" "=r,r") + (plus:AM (match_operand:AM 1 "register_operand" " 0,0") + (match_operand:AM 2 "reg_or_imm_operand" " r,I")))] + "1" + "add\t%0,%2" + [(set_attr "type" "")]) + +;;; Subtraction +(define_insn "sub3" + [(set (match_operand:AM 0 "register_operand" "=r,r") + (plus:AM (match_operand:AM 1 "register_operand" " 0,0") + (match_operand:AM 2 "reg_or_imm_operand" " r,I")))] + "1" + "sub\t%0,%2" + [(set_attr "type" "")]) + +;;; Negation +(define_insn "neg2" + [(set (match_operand:AM 0 "register_operand" "=r") + (neg:AM (match_operand:AM 1 "register_operand" " 0")))] + "" + "neg\t%0" + [(set_attr "type" "")]) + +;;; Multiplication +(define_insn "mul3" + [(set (match_operand:AM 0 "register_operand" "=r,r") + (mult:AM (match_operand:AM 1 "register_operand" " 0,0") + (match_operand:AM 2 "reg_or_imm_operand" " r,I")))] + "" + "mul\t%0,%2" + [(set_attr "type" "")]) + +(define_insn "*mulsi3_extended" + [(set (match_operand:DI 0 "register_operand" "=r,r") + (sign_extend:DI + (mult:SI (match_operand:SI 1 "register_operand" "0,0") + (match_operand:SI 2 "reg_or_imm_operand" "r,I"))))] + "" + "mul32\t%0,%2" + [(set_attr "type" "alu32")]) + +;; Division +(define_insn "div3" + [(set (match_operand:AM 0 "register_operand" "=r,r") + (div:AM (match_operand:AM 1 "register_operand" " 0,0") + (match_operand:AM 2 "reg_or_imm_operand" "r,I")))] + "" + "div\t%0,%2" + [(set_attr "type" "")]) + +(define_insn "udiv3" + [(set (match_operand:AM 0 "register_operand" "=r,r") + (div:AM (match_operand:AM 1 "register_operand" " 0,0") + (match_operand:AM 2 "reg_or_imm_operand" "r,I")))] + "" + "div\t%0,%2" + [(set_attr "type" "")]) + +;;; Modulus +(define_insn "mod3" + [(set (match_operand:AM 0 "register_operand" "=r,r") + (mod:AM (match_operand:AM 1 "register_operand" " 0,0") + (match_operand:AM 2 "reg_or_imm_operand" "r,I")))] + "" + "mod\t%0,%2" + [(set_attr "type" "")]) + +(define_insn "umod3" + [(set (match_operand:AM 0 "register_operand" "=r,r") + (mod:AM (match_operand:AM 1 "register_operand" " 0,0") + (match_operand:AM 2 "reg_or_imm_operand" "r,I")))] + "" + "mod\t%0,%2" + [(set_attr "type" "")]) + +;;; Logical AND +(define_insn "and3" + [(set (match_operand:AM 0 "register_operand" "=r,r") + (and:AM (match_operand:AM 1 "register_operand" " 0,0") + (match_operand:AM 2 "reg_or_imm_operand" "r,I")))] + "" + "and\t%0,%2" + [(set_attr "type" "")]) + +;;; Logical inclusive-OR +(define_insn "ior3" + [(set (match_operand:AM 0 "register_operand" "=r,r") + (ior:AM (match_operand:AM 1 "register_operand" " 0,0") + (match_operand:AM 2 "reg_or_imm_operand" "r,I")))] + "" + "or\t%0,%2" + [(set_attr "type" "")]) + +;;; Logical exclusive-OR +(define_insn "xor3" + [(set (match_operand:AM 0 "register_operand" "=r,r") + (xor:AM (match_operand:AM 1 "register_operand" " 0,0") + (match_operand:AM 2 "reg_or_imm_operand" "r,I")))] + "" + "xor\t%0,%2" + [(set_attr "type" "")]) + +;;;; Conversions + +;;; Zero-extensions + +;; For register operands smaller than 32-bit zero-extending is +;; achieved ANDing the value in the source register to a suitable +;; mask. +;; +;; For register operands bigger or equal than 32-bit, we generate a +;; sequence of two shift instructions to zero the high 32-bits of the +;; destination register. +;; +;; For memory operands, of any width, zero-extending is achieved using +;; the ldx{bhwdw} instructions to load the values in registers. + +(define_insn "zero_extendhidi2" + [(set (match_operand:DI 0 "register_operand" "=r,r") + (zero_extend:DI (match_operand:HI 1 "reg_or_indirect_memory_operand" "r,m")))] + "" + "@ + and\t%0,0xffff + ldxh\t%0,%1" + [(set_attr "type" "alu,ldx")]) + +(define_insn "zero_extendqidi2" + [(set (match_operand:DI 0 "register_operand" "=r,r") + (zero_extend:DI (match_operand:QI 1 "reg_or_indirect_memory_operand" "r,m")))] + "" + "@ + and\t%0,0xff + ldxb\t%0,%1" + [(set_attr "type" "alu,ldx")]) + +(define_expand "zero_extendsidi2" + [(set (match_operand:DI 0 "register_operand" "=r,r") + (zero_extend:DI (match_operand:SI 1 "reg_or_indirect_memory_operand" "r,m")))] + "" +{ + if (register_operand (operands[1], SImode)) + { + operands[1] = gen_lowpart (DImode, operands[1]); + emit_insn (gen_ashldi3 (operands[0], operands[1], GEN_INT (32))); + emit_insn (gen_lshrdi3 (operands[0], operands[0], GEN_INT (32))); + DONE; + } +}) + +(define_insn "*zero_extendsidi2" + [(set (match_operand:DI 0 "register_operand" "=r,r") + (zero_extend:DI (match_operand:SI 1 "reg_or_indirect_memory_operand" "0,m")))] + "" + "@ + lsh\t%0,32\n\trsh\t%0,32 + ldxw\t%0,%1" + [(set_attr "type" "alu,ldx") + (set_attr "length" "16,8")]) + +;;; Sign-extension + +;; Sign-extending a 32-bit value into a 64-bit value is achieved using +;; shifting, with instructions generated by the expand below. + +(define_expand "extendsidi2" + [(set (match_operand:DI 0 "register_operand" "=r") + (sign_extend:DI (match_operand:SI 1 "register_operand" "r")))] + "" +{ + operands[1] = gen_lowpart (DImode, operands[1]); + emit_insn (gen_ashldi3 (operands[0], operands[1], GEN_INT (32))); + emit_insn (gen_ashrdi3 (operands[0], operands[0], GEN_INT (32))); + DONE; +}) + +(define_insn "*extendsidi2" + [(set (match_operand:DI 0 "register_operand" "=r") + (sign_extend:DI (match_operand:SI 1 "register_operand" "0")))] + "" + "lsh\t%0,32\n\tarsh\t%0,32" + [(set_attr "type" "alu") + (set_attr "length" "16")]) + +;;;; Data movement + +(define_mode_iterator AMM [QI HI SI DI SF DF]) + +(define_expand "mov" + [(set (match_operand:AMM 0 "general_operand" "") + (match_operand:AMM 1 "general_operand" ""))] + "" + " +{ + if (!register_operand(operands[0], mode) + && !register_operand(operands[1], mode)) + operands[1] = force_reg (mode, operands[1]); + + /* In cases where the moved entity is a constant address, we + need to emit an extra mov and modify the second operand to + obtain something like: + + lddw %T, %1 + ldxw %0, [%T+0] + + Ditto for stores. */ + + if (MEM_P (operands[1]) + && CONSTANT_ADDRESS_P (XEXP (operands[1], 0))) + { + rtx tmp = gen_reg_rtx (DImode); + + emit_move_insn (tmp, XEXP (operands[1], 0)); + operands[1] = gen_rtx_MEM (mode, tmp); + } + + if (MEM_P (operands[0]) + && CONSTANT_ADDRESS_P (XEXP (operands[0], 0))) + { + rtx tmp = gen_reg_rtx (DImode); + + emit_move_insn (tmp, XEXP (operands[0], 0)); + operands[0] = gen_rtx_MEM (mode, tmp); + } + +}") + +(define_mode_iterator MM [QI HI SI DI SF DF]) + +(define_insn "*mov" + [(set (match_operand:MM 0 "mov_dst_operand" "=r, r,r,m,m") + (match_operand:MM 1 "mov_src_operand" " m,rI,B,r,I"))] + "" + "@ + ldx\t%0,%1 + mov\t%0,%1 + lddw\t%0,%1 + stx\t%0,%1 + st\t%0,%1" +[(set_attr "type" "ldx,alu,alu,stx,st")]) + +;;;; Shifts + +(define_mode_iterator SIM [SI DI]) + +(define_insn "ashr3" + [(set (match_operand:SIM 0 "register_operand" "=r,r") + (ashiftrt:SIM (match_operand:SIM 1 "register_operand" " 0,0") + (match_operand:SIM 2 "reg_or_imm_operand" " r,I")))] + "" + "arsh\t%0,%2" + [(set_attr "type" "")]) + +(define_insn "ashl3" + [(set (match_operand:SIM 0 "register_operand" "=r,r") + (ashift:SIM (match_operand:SIM 1 "register_operand" " 0,0") + (match_operand:SIM 2 "reg_or_imm_operand" " r,I")))] + "" + "lsh\t%0,%2" + [(set_attr "type" "")]) + +(define_insn "lshr3" + [(set (match_operand:SIM 0 "register_operand" "=r,r") + (lshiftrt:SIM (match_operand:SIM 1 "register_operand" " 0,0") + (match_operand:SIM 2 "reg_or_imm_operand" " r,I")))] + "" + "rsh\t%0,%2" + [(set_attr "type" "")]) + +;;;; Conditional branches + +;; The eBPF jump instructions use 64-bit arithmetic when evaluating +;; the jump conditions. Therefore we use DI modes below. + +(define_expand "cbranchdi4" + [(set (pc) + (if_then_else (match_operator 0 "comparison_operator" + [(match_operand:DI 1 "register_operand" "r") + (match_operand:DI 2 "reg_or_imm_operand" "rI")]) + (label_ref (match_operand 3 "" "")) + (pc)))] + "" +{ + if (!ordered_comparison_operator (operands[0], VOIDmode)) + FAIL; +}) + +(define_insn "*branch_on_di" + [(set (pc) + (if_then_else (match_operator 3 "ordered_comparison_operator" + [(match_operand:DI 0 "register_operand" "r") + (match_operand:DI 1 "reg_or_imm_operand" "rI")]) + (label_ref (match_operand 2 "" "")) + (pc)))] + "" +{ + int code = GET_CODE (operands[3]); + + switch (code) + { + case EQ: return "jeq\t%0,%1,%2"; break; + case NE: return "jne\t%0,%1,%2"; break; + case LT: return "jslt\t%0,%1,%2"; break; + case LE: return "jsle\t%0,%1,%2"; break; + case GT: return "jsgt\t%0,%1,%2"; break; + case GE: return "jsge\t%0,%1,%2"; break; + case LTU: return "jlt\t%0,%1,%2"; break; + case LEU: return "jle\t%0,%1,%2"; break; + case GTU: return "jgt\t%0,%1,%2"; break; + case GEU: return "jge\t%0,%1,%2"; break; + default: + error ("unknown comparison code %d in *branch_on_di\n", code); + return ""; + } +} + [(set_attr "type" "jmp")]) + +;;;; Unconditional branches + +(define_insn "jump" + [(set (pc) + (label_ref (match_operand 0 "" "")))] + "" + "ja\t%0" +[(set_attr "type" "jmp")]) + +;;;; Function prologue/epilogue + +(define_insn "exit" + [(simple_return)] + "" + "exit" + [(set_attr "type" "jmp")]) + +(define_expand "prologue" + [(const_int 0)] + "" +{ + bpf_expand_prologue (); + DONE; +}) + +(define_expand "epilogue" + [(const_int 0)] + "" +{ + bpf_expand_epilogue (); + DONE; +}) + +;;;; Function calls + +(define_insn "call" + [(call (match_operand:DI 0 "call_operand" "m") + (match_operand:SI 1 "general_operand" ""))] + ;; operands[2] is next_arg_register + ;; operands[3] is struct_value_size_rtx. + "" + { return bpf_output_call (operands[0]); } + [(set_attr "type" "jmp")]) + +(define_insn "call_value" + [(set (match_operand 0 "register_operand" "") + (call (match_operand:DI 1 "call_operand" "m") + (match_operand:SI 2 "general_operand" "")))] + ;; operands[3] is next_arg_register + ;; operands[4] is struct_value_size_rtx. + "" + { return bpf_output_call (operands[1]); } + [(set_attr "type" "jmp")]) + +(define_insn "sibcall" + [(call (label_ref (match_operand 0 "" "")) + (match_operand:SI 1 "general_operand" ""))] + ;; operands[2] is next_arg_register + ;; operands[3] is struct_value_size_rtx. + "" + "ja\t%0" + [(set_attr "type" "jmp")]) + +;;;; Non-generic load instructions + +(define_mode_iterator LDM [QI HI SI DI]) +(define_mode_attr ldop [(QI "b") (HI "h") (SI "w") (DI "dw")]) + +(define_insn "ldind" + [(set (reg:LDM R0_REGNUM) + (unspec:LDM [(match_operand:DI 0 "register_operand" "r") + (match_operand:SI 1 "imm32_operand" "I")] + UNSPEC_LDINDABS)) + (clobber (reg:DI R1_REGNUM)) + (clobber (reg:DI R2_REGNUM)) + (clobber (reg:DI R3_REGNUM)) + (clobber (reg:DI R4_REGNUM))] + "" + "ldind\t%0,%1" + [(set_attr "type" "ld")]) + +(define_insn "ldabs" + [(set (reg:LDM R0_REGNUM) + (unspec:LDM [(match_operand:SI 0 "imm32_operand" "I") + (match_operand:SI 1 "imm32_operand" "I")] + UNSPEC_LDINDABS)) + (clobber (reg:DI R1_REGNUM)) + (clobber (reg:DI R2_REGNUM)) + (clobber (reg:DI R3_REGNUM)) + (clobber (reg:DI R4_REGNUM))] + "" + "ldabs\t%0" + [(set_attr "type" "ld")]) + +;;;; Atomic increments + +(define_mode_iterator AMO [SI DI]) + +(define_insn "atomic_add" + [(set (match_operand:AMO 0 "indirect_memory_operand" "+m") + (unspec_volatile:AMO + [(plus:AMO (match_dup 0) + (match_operand:AMO 1 "register_operand" "r")) + (match_operand:SI 2 "const_int_operand")] ;; Memory model. + UNSPEC_XADD))] + "" + "xadd\t%0,%1" + [(set_attr "type" "xadd")]) diff --git a/gcc/config/bpf/bpf.opt b/gcc/config/bpf/bpf.opt new file mode 100644 index 00000000000..b04c8c8f504 --- /dev/null +++ b/gcc/config/bpf/bpf.opt @@ -0,0 +1,119 @@ +; Options for the eBPF compiler port. + +; Copyright (C) 2019 Free Software Foundation, Inc. +; +; This file is part of GCC. +; +; GCC is free software; you can redistribute it and/or modify it under +; the terms of the GNU General Public License as published by the Free +; Software Foundation; either version 3, or (at your option) any later +; version. +; +; GCC is distributed in the hope that it will be useful, but WITHOUT ANY +; WARRANTY; without even the implied warranty of MERCHANTABILITY or +; FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License +; for more details. +; +; You should have received a copy of the GNU General Public License +; along with GCC; see the file COPYING3. If not see +; . + +HeaderInclude +config/bpf/bpf-opts.h + +; Selecting the kind of kernel the eBPF will be running on. + +mkernel= +Target RejectNegative Joined Var(bpf_kernel) Enum(bpf_kernel) Init(LINUX_LATEST) +Generate eBPF for the given Linux kernel version. + +Enum +Name(bpf_kernel) Type(enum bpf_kernel_version) + +EnumValue +Enum(bpf_kernel) String(native) Value(LINUX_NATIVE) DriverOnly + +EnumVAlue +Enum(bpf_kernel) String(latest) Value(LINUX_LATEST) DriverOnly + +EnumValue +Enum(bpf_kernel) String(4.0) Value(LINUX_V4_0) + +EnumValue +Enum(bpf_kernel) String(4.1) Value(LINUX_V4_1) + +EnumValue +Enum(bpf_kernel) String(4.2) Value(LINUX_V4_2) + +EnumValue +Enum(bpf_kernel) String(4.3) Value(LINUX_V4_3) + +EnumValue +Enum(bpf_kernel) String(4.4) Value(LINUX_V4_4) + +EnumValue +Enum(bpf_kernel) String(4.5) Value(LINUX_V4_5) + +EnumValue +Enum(bpf_kernel) String(4.6) Value(LINUX_V4_6) + +EnumValue +Enum(bpf_kernel) String(4.7) Value(LINUX_V4_7) + +EnumValue +Enum(bpf_kernel) String(4.8) Value(LINUX_V4_8) + +EnumValue +Enum(bpf_kernel) String(4.9) Value(LINUX_V4_9) + +EnumValue +Enum(bpf_kernel) String(4.10) Value(LINUX_V4_10) + +EnumValue +Enum(bpf_kernel) String(4.11) Value(LINUX_V4_11) + +EnumValue +Enum(bpf_kernel) String(4.12) Value(LINUX_V4_12) + +EnumValue +Enum(bpf_kernel) String(4.13) Value(LINUX_V4_13) + +EnumValue +Enum(bpf_kernel) String(4.14) Value(LINUX_V4_14) + +EnumValue +Enum(bpf_kernel) String(4.15) Value(LINUX_V4_15) + +EnumValue +Enum(bpf_kernel) String(4.16) Value(LINUX_V4_16) + +EnumValue +Enum(bpf_kernel) String(4.17) Value(LINUX_V4_17) + +EnumValue +Enum(bpf_kernel) String(4.18) Value(LINUX_V4_18) + +EnumValue +Enum(bpf_kernel) String(4.19) Value(LINUX_V4_19) + +EnumValue +Enum(bpf_kernel) String(4.20) Value(LINUX_V4_20) + +EnumValue +Enum(bpf_kernel) String(5.0) Value(LINUX_V5_0) + +EnumValue +Enum(bpf_kernel) String(5.1) Value(LINUX_V5_1) + +EnumValue +Enum(bpf_kernel) String(5.2) Value(LINUX_V5_2) + +; Selecting big endian or little endian targets. + +mbig-endian +Target RejectNegative Report InverseMask(LITTLE_ENDIAN) +Generate big-endian eBPF. + +mlittle-endian +Target RejectNegative Report Mask(LITTLE_ENDIAN) +Generate little-endian eBPF. diff --git a/gcc/config/bpf/constraints.md b/gcc/config/bpf/constraints.md new file mode 100644 index 00000000000..aa886d0c075 --- /dev/null +++ b/gcc/config/bpf/constraints.md @@ -0,0 +1,29 @@ +;; Constraint definitions for eBPF. +;; Copyright (C) 2019 Free Software Foundation, Inc. +;; +;; This file is part of GCC. +;; +;; GCC is free software; you can redistribute it and/or modify +;; it under the terms of the GNU General Public License as published by +;; the Free Software Foundation; either version 3, or (at your option) +;; any later version. +;; +;; GCC is distributed in the hope that it will be useful, +;; but WITHOUT ANY WARRANTY; without even the implied warranty of +;; MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the +;; GNU General Public License for more details. +;; +;; You should have received a copy of the GNU General Public License +;; along with GCC; see the file COPYING3. If not see +;; . + +(define_constraint "I" + "A 32-bit signed immediate." + (and (match_code "const_int") + (match_test "IN_RANGE (ival, -1 - 0x7fffffff, 0x7fffffff)"))) + +(define_constraint "B" + "A constant argument for LDDW." + (ior (match_code "const,symbol_ref,label_ref,const_double") + (and (match_code "const_int") + (match_test "IN_RANGE (ival, -1 - 0x7fffffffffffffff, 0x7fffffffffffffff)")))) diff --git a/gcc/config/bpf/predicates.md b/gcc/config/bpf/predicates.md new file mode 100644 index 00000000000..73cd2fe9b90 --- /dev/null +++ b/gcc/config/bpf/predicates.md @@ -0,0 +1,105 @@ +;; Predicate definitions for eBPF. +;; Copyright (C) 2019 Free Software Foundation, Inc. +;; +;; This file is part of GCC. +;; +;; GCC is free software; you can redistribute it and/or modify +;; it under the terms of the GNU General Public License as published by +;; the Free Software Foundation; either version 3, or (at your option) +;; any later version. +;; +;; GCC is distributed in the hope that it will be useful, +;; but WITHOUT ANY WARRANTY; without even the implied warranty of +;; MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the +;; GNU General Public License for more details. +;; +;; You should have received a copy of the GNU General Public License +;; along with GCC; see the file COPYING3. If not see +;; . + +(define_predicate "reg_or_imm_operand" + (ior (and (match_code "const_int") + (match_test "IN_RANGE (INTVAL (op), -1 - 0x7fffffff, 0x7fffffff)")) + (match_operand 0 "register_operand"))) + +(define_predicate "imm32_operand" + (ior (and (match_code "const_int") + (match_test "IN_RANGE (INTVAL (op), 0, 0xffffffff)")) + (match_code "symbol_ref,label_ref,const"))) + +(define_predicate "lddw_operand" + (ior (and (match_code "const_int") + (match_test "IN_RANGE (INTVAL (op), 0, 0xffffffffffffffff)")) + (match_code "symbol_ref,label_ref,const,const_double"))) + +(define_predicate "call_operand" + (match_code "mem") +{ + if (GET_CODE (op) != MEM) + return 0; + + op = XEXP (op, 0); + + if (GET_MODE (op) != mode + && GET_MODE (op) != VOIDmode + && mode != VOIDmode) + return 0; + + switch (GET_CODE (op)) + { + case REG: + case CONST_INT: + case SYMBOL_REF: + case LABEL_REF: + return 1; + break; + case CONST: + { + switch (GET_CODE (XEXP (op, 0))) + { + case SYMBOL_REF: + case LABEL_REF: + case CONST_INT: + return 1; + default: + break; + } + break; + } + default: + break; + } + + return 0; +}) + +(define_predicate "indirect_memory_operand" + (match_operand 0 "memory_operand") +{ + if (GET_CODE (op) != MEM) + return 0; + + op = XEXP (op, 0); + + if (CONSTANT_ADDRESS_P (op)) + return 0; + + return 1; +}) + +(define_predicate "reg_or_indirect_memory_operand" + (ior (match_operand 0 "register_operand") + (match_operand 0 "indirect_memory_operand"))) + +(define_predicate "mov_dst_operand" + (ior (match_operand 0 "register_operand") + (match_operand 0 "indirect_memory_operand"))) + +(define_predicate "mov_src_operand" + (ior (match_operand 0 "indirect_memory_operand") + (match_operand 0 "reg_or_imm_operand") + (match_operand 0 "lddw_operand"))) + +(define_predicate "register_compare_operator" + (match_code "eq,ne,geu,gtu,ge,gt")) + diff --git a/gcc/config/bpf/t-bpf b/gcc/config/bpf/t-bpf new file mode 100644 index 00000000000..e69de29bb2d