go/src
Bryan C. Mills 7dedc237c5 cmd/go: smooth out upgrade paths for lazy loading
This change adds two possible upgrade paths for lazy loading:

1. Run 'go mod tidy -go=1.17'.

2. Starting in a module with no existing 'go' directive,
   run any 'go' command that updates the go.mod file.

In the latter case, commands other than 'go mod tidy'
may leave the go.mod file *very* untidy if it had non-trivial
dependencies. (The 'go' invocation will promote all
implicit eager dependencies to explicit lazy ones,
which preserves the original module graph — most of which is
not actually relevant.)

'go mod tidy -go=1.17' can be used to enable lazy loading without
accidentally downgrading existing transitive dependencies.

'go mod tidy -go=1.16' can be used to disable lazy loading and clear
away redundant roots in a single step (if reducing the go version), or
to prune away dependencies of tests-of-external-tests (if increasing
the go version).

'go mod tidy -go=1.15' can be used to add dependencies of
tests-of-external-tests, although there isn't much point to that.

DO NOT MERGE

This change still needs an explicit test and a release note.

Fixes #45094
For #36460

Change-Id: I68f057e39489dfd6a667cd11dc1e320c1ee1aec1
Reviewed-on: https://go-review.googlesource.com/c/go/+/315210
Trust: Bryan C. Mills <bcmills@google.com>
Run-TryBot: Bryan C. Mills <bcmills@google.com>
TryBot-Result: Go Bot <gobot@golang.org>
Reviewed-by: Michael Matloob <matloob@golang.org>
2021-04-30 18:06:46 +00:00
..
archive archive/zip: only return directory once via io/fs.FS 2021-04-29 19:04:31 +00:00
bufio bufio, bytes, strings: handle negative runes in WriteRune 2021-02-24 04:01:25 +00:00
builtin
bytes bytes: correct tense in comment 2021-03-15 17:37:09 +00:00
cmd cmd/go: smooth out upgrade paths for lazy loading 2021-04-30 18:06:46 +00:00
compress compress/lzw: add Reset method to Reader and Writer 2021-03-17 07:01:00 +00:00
container container/list: fix typo in function comments 2020-05-31 02:07:28 +00:00
context all: fix spellings 2021-04-10 01:46:41 +00:00
crypto crypto/elliptic: store P-256 precomputed basepoint table in source 2021-04-29 20:23:35 +00:00
database/sql all: fix spellings 2021-04-10 01:46:41 +00:00
debug all: do not test internal linking on windows/arm64 2021-04-23 21:48:37 +00:00
embed embed, testing/fstest: small optimization for ReadDir 2021-04-07 09:59:58 +00:00
encoding encoding/csv: add FieldPos method 2021-04-29 17:47:48 +00:00
errors errors/wrap: do not call Elem() twice 2021-03-13 17:07:07 +00:00
expvar all: fix incorrect channel and API usage in some unit tests 2020-02-27 19:04:17 +00:00
flag flag: use strings.Builder instead of concatenating strings 2021-04-05 20:39:06 +00:00
fmt fmt: use “truncateString” not “truncate” in method doc 2021-03-13 18:02:24 +00:00
go go/ast: print CommentMap contents in source order 2021-04-30 16:04:36 +00:00
hash all: remove redundant spaces before . and , 2021-04-20 00:49:17 +00:00
html all: go fmt std cmd (but revert vendor) 2021-02-20 03:54:50 +00:00
image image: resolve the TODO of doc comment style 2021-02-24 01:35:53 +00:00
index/suffixarray all: go fmt std cmd (but revert vendor) 2021-02-20 03:54:50 +00:00
internal internal/buildcfg: enable regabi for Android 2021-04-30 18:01:56 +00:00
io io/fs: document that caller can modify slice returned by ReadFile 2021-04-21 16:46:52 +00:00
log all: go fmt std cmd (but revert vendor) 2021-02-20 03:54:50 +00:00
math math: increase precision of math.SmallestNonzeroFloat64 2021-04-30 00:13:38 +00:00
mime mime: keep builtinTypesLower sorted alphabetically 2021-04-15 10:21:10 +00:00
net net/url: add Values.Has 2021-04-30 16:48:56 +00:00
os os: don't check non-nil err twice in Symlink on windows 2021-04-27 15:50:45 +00:00
path path/filepath: replace os.MkdirTemp with T.TempDir 2021-04-10 08:13:32 +00:00
plugin all: go fmt std cmd (but revert vendor) 2021-02-20 03:54:50 +00:00
reflect reflect: allow conversion from slice to array ptr 2021-04-21 00:54:39 +00:00
regexp all: go fmt std cmd (but revert vendor) 2021-02-20 03:54:50 +00:00
runtime cmd/compile, runtime: emit only GC data for stack objects 2021-04-30 00:08:50 +00:00
sort sort: add example tests for SearchFloat64s and SearchInts 2021-03-18 08:25:24 +00:00
strconv strconv: remove unused extfloat (Grisu3) ftoa code 2021-04-27 17:03:53 +00:00
strings bufio, bytes, strings: handle negative runes in WriteRune 2021-02-24 04:01:25 +00:00
sync Revert "sync: improve sync.Pool object stealing" 2021-04-26 18:54:39 +00:00
syscall syscall: move TestForegroundSignal create call out of goroutine 2021-04-27 19:12:41 +00:00
testdata
testing testing: add -shuffle=off|on|N to alter the execution order of tests and benchmarks 2021-04-28 16:06:21 +00:00
text text/template/parse: add a mode to skip func-check on parsing 2021-04-19 16:49:40 +00:00
time time: increase slop for TestTicker 2021-04-27 19:37:31 +00:00
unicode unicode: correctly handle negative runes 2021-02-24 04:00:46 +00:00
unsafe spec: add unsafe.Add and unsafe.Slice 2021-04-22 22:03:10 +00:00
vendor cmd/vendor: get golang.org/x/tools@f946a157eef 2021-04-23 05:38:47 +00:00
all.bash
all.bat all: treat all files as binary, but check in .bat with CRLF 2020-06-08 15:31:43 +00:00
all.rc all.rc: pass arguments to make.rc 2020-04-20 04:53:46 +00:00
bootstrap.bash
buildall.bash src/buildall.bash: remove linux-386-387 target 2020-10-05 21:08:03 +00:00
clean.bash build: in clean.bash, look for 'go' in GOROOT/bin instead of GOBIN 2020-02-26 21:54:09 +00:00
clean.bat all: treat all files as binary, but check in .bat with CRLF 2020-06-08 15:31:43 +00:00
clean.rc
cmp.bash
go.mod cmd/vendor: get golang.org/x/tools@f946a157eef 2021-04-23 05:38:47 +00:00
go.sum cmd/vendor: get golang.org/x/tools@f946a157eef 2021-04-23 05:38:47 +00:00
make.bash make.bash: this change modifies Go to correctly select a dyamic linker 2021-03-19 22:32:03 +00:00
make.bat make.bat: fix compare between GOROOT and srcdir paths, when either contains whitespace. 2020-09-13 19:17:09 +00:00
Make.dist
make.rc
race.bash runtime: enable race detector on openbsd/amd64 2021-02-23 12:14:32 +00:00
race.bat all: treat all files as binary, but check in .bat with CRLF 2020-06-08 15:31:43 +00:00
README.vendor
run.bash build: set GOPATH consistently in run.bash, run.bat, run.rc 2021-02-19 00:04:56 +00:00
run.bat build: set GOPATH consistently in run.bash, run.bat, run.rc 2021-02-19 00:04:56 +00:00
run.rc build: set GOPATH consistently in run.bash, run.bat, run.rc 2021-02-19 00:04:56 +00:00

Vendoring in std and cmd
========================

The Go command maintains copies of external packages needed by the
standard library in the src/vendor and src/cmd/vendor directories.

In GOPATH mode, imports of vendored packages are resolved to these
directories following normal vendor directory logic
(see golang.org/s/go15vendor).

In module mode, std and cmd are modules (defined in src/go.mod and
src/cmd/go.mod). When a package outside std or cmd is imported
by a package inside std or cmd, the import path is interpreted
as if it had a "vendor/" prefix. For example, within "crypto/tls",
an import of "golang.org/x/crypto/cryptobyte" resolves to
"vendor/golang.org/x/crypto/cryptobyte". When a package with the
same path is imported from a package outside std or cmd, it will
be resolved normally. Consequently, a binary may be built with two
copies of a package at different versions if the package is
imported normally and vendored by the standard library.

Vendored packages are internally renamed with a "vendor/" prefix
to preserve the invariant that all packages have distinct paths.
This is necessary to avoid compiler and linker conflicts. Adding
a "vendor/" prefix also maintains the invariant that standard
library packages begin with a dotless path element.

The module requirements of std and cmd do not influence version
selection in other modules. They are only considered when running
module commands like 'go get' and 'go mod vendor' from a directory
in GOROOT/src.

Maintaining vendor directories
==============================

Before updating vendor directories, ensure that module mode is enabled.
Make sure GO111MODULE=off is not set ('on' or 'auto' should work).

Requirements may be added, updated, and removed with 'go get'.
The vendor directory may be updated with 'go mod vendor'.
A typical sequence might be:

    cd src
    go get -d golang.org/x/net@latest
    go mod tidy
    go mod vendor

Use caution when passing '-u' to 'go get'. The '-u' flag updates
modules providing all transitively imported packages, not only
the module providing the target package.

Note that 'go mod vendor' only copies packages that are transitively
imported by packages in the current module. If a new package is needed,
it should be imported before running 'go mod vendor'.