-- Logs begin at Fri 2022-04-08 01:56:32 UTC, end at Fri 2022-04-08 03:10:19 UTC. -- Apr 08 02:35:42.389047 dv-cinder-837052-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Apr 08 02:35:42.398061 dv-cinder-837052-1-iscsi devstack@n-api.service[82456]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 08 02:35:42.400024 dv-cinder-837052-1-iscsi devstack@n-api.service[82456]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Apr 8 02:35:42 2022] *** Apr 08 02:35:42.400024 dv-cinder-837052-1-iscsi devstack@n-api.service[82456]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Apr 08 02:35:42.400024 dv-cinder-837052-1-iscsi devstack@n-api.service[82456]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Apr 08 02:35:42.400024 dv-cinder-837052-1-iscsi devstack@n-api.service[82456]: nodename: dv-cinder-837052-1-iscsi Apr 08 02:35:42.400024 dv-cinder-837052-1-iscsi devstack@n-api.service[82456]: machine: x86_64 Apr 08 02:35:42.400024 dv-cinder-837052-1-iscsi devstack@n-api.service[82456]: clock source: unix Apr 08 02:35:42.400024 dv-cinder-837052-1-iscsi devstack@n-api.service[82456]: pcre jit disabled Apr 08 02:35:42.400024 dv-cinder-837052-1-iscsi devstack@n-api.service[82456]: detected number of CPU cores: 4 Apr 08 02:35:42.400024 dv-cinder-837052-1-iscsi devstack@n-api.service[82456]: current working directory: / Apr 08 02:35:42.400024 dv-cinder-837052-1-iscsi devstack@n-api.service[82456]: detected binary path: /usr/bin/uwsgi-core Apr 08 02:35:42.400710 dv-cinder-837052-1-iscsi devstack@n-api.service[82456]: your processes number limit is 47680 Apr 08 02:35:42.400710 dv-cinder-837052-1-iscsi devstack@n-api.service[82456]: your memory page size is 4096 bytes Apr 08 02:35:42.400710 dv-cinder-837052-1-iscsi devstack@n-api.service[82456]: detected max file descriptor number: 2048 Apr 08 02:35:42.400710 dv-cinder-837052-1-iscsi devstack@n-api.service[82456]: lock engine: pthread robust mutexes Apr 08 02:35:42.400710 dv-cinder-837052-1-iscsi devstack@n-api.service[82456]: thunder lock: enabled Apr 08 02:35:42.400710 dv-cinder-837052-1-iscsi devstack@n-api.service[82456]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 08 02:35:42.400710 dv-cinder-837052-1-iscsi devstack@n-api.service[82456]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Apr 08 02:35:42.440035 dv-cinder-837052-1-iscsi devstack@n-api.service[82456]: Python main interpreter initialized at 0x5615903c29c0 Apr 08 02:35:42.440035 dv-cinder-837052-1-iscsi devstack@n-api.service[82456]: python threads support enabled Apr 08 02:35:42.440035 dv-cinder-837052-1-iscsi devstack@n-api.service[82456]: your server socket listen backlog is limited to 100 connections Apr 08 02:35:42.440035 dv-cinder-837052-1-iscsi devstack@n-api.service[82456]: your mercy for graceful operations on workers is 90 seconds Apr 08 02:35:42.440375 dv-cinder-837052-1-iscsi devstack@n-api.service[82456]: mapped 403077 bytes (393 KB) for 2 cores Apr 08 02:35:42.440451 dv-cinder-837052-1-iscsi devstack@n-api.service[82456]: *** Operational MODE: preforking *** Apr 08 02:35:42.440677 dv-cinder-837052-1-iscsi devstack@n-api.service[82456]: *** uWSGI is running in multiple interpreter mode *** Apr 08 02:35:42.440677 dv-cinder-837052-1-iscsi devstack@n-api.service[82456]: spawned uWSGI master process (pid: 82456) Apr 08 02:35:42.440859 dv-cinder-837052-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Apr 08 02:35:42.442400 dv-cinder-837052-1-iscsi devstack@n-api.service[82456]: spawned uWSGI worker 1 (pid: 82457, cores: 1) Apr 08 02:35:42.442400 dv-cinder-837052-1-iscsi devstack@n-api.service[82456]: spawned uWSGI worker 2 (pid: 82458, cores: 1) Apr 08 02:35:42.442400 dv-cinder-837052-1-iscsi devstack@n-api.service[82456]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 08 02:35:46.475750 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 08 02:35:46.476489 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 08 02:35:46.476489 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 08 02:35:46.476780 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 08 02:35:46.477031 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 08 02:35:46.477407 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.477727 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.478041 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] bandwidth_poll_interval = 600 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.478373 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] bindir = /usr/local/bin {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.478688 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.479003 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.479889 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.480074 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 08 02:35:46.480470 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.480558 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 08 02:35:46.480637 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.480774 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.480868 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 08 02:35:46.481090 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.481184 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 08 02:35:46.481338 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.481438 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 08 02:35:46.481642 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.481746 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.481956 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837052-1-iscsi {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.482049 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.482269 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.482371 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] bandwidth_poll_interval = 600 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.482565 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.482654 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] bindir = /usr/local/bin {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.482889 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.482976 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.483198 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.483288 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.483497 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.483582 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.483810 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.483903 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.484114 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.484250 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.484476 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.484600 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.484796 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.485056 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.485318 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.485426 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.485621 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.485725 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837052-1-iscsi {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.485927 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.486033 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.486255 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.486351 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.486558 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.486651 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.486884 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.487017 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.487187 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.487323 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.487488 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.487573 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.487790 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.487879 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.488093 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.488288 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.488405 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837052-1-iscsi {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.488595 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.488717 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.488897 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.489022 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.489201 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.489330 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.489532 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.489734 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.489846 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.490039 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.490135 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.490342 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.490436 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.490653 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.490762 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.490985 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.491070 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.491285 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.491391 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.491603 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.491688 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837052-1-iscsi {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.491915 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.492000 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.492223 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.492323 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.492528 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.492620 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.492822 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.492937 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.493122 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.493246 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.493421 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.493555 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.493729 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.493871 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.494027 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.494202 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.494343 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.494488 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.494574 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.495397 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.495493 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.495748 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.495912 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.496064 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.496148 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.496374 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.496482 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.496619 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.496713 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.496862 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.496948 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.497174 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.497261 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.497531 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.497631 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.497785 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.497877 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.498085 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.498170 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.498362 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.498453 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.498677 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.498764 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.498988 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.499084 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.499288 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.499374 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.499590 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.499676 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.499840 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.499933 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.500095 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.500215 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.500410 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.500501 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.500725 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.500824 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.501029 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.501116 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.501333 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.501421 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.501635 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.501722 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.501938 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.502024 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.502238 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.502330 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.502540 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.502627 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.502864 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.502963 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.503166 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.503252 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.503474 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.503567 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.503782 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.503867 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.504080 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.504164 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.504381 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.504525 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.504682 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.504812 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.504994 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.505132 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.505302 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.505441 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.505599 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.505727 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.505859 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.506001 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.506136 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.506273 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.506404 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.506536 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.506716 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.506845 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.507015 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.507163 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.507313 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.507468 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.507611 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.507795 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.507904 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.508105 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.508191 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.508421 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.508514 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.508736 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.508871 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.509036 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.509122 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.509290 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.509388 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.509578 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.509663 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.509877 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.509961 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.510185 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.510299 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.510510 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.510651 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.510840 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.510956 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.511143 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.511239 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.511440 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.511525 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.511741 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.511826 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.512042 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.512138 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.512345 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.512430 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.512647 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.512732 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.512942 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.513028 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.513239 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.513324 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.513540 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.513625 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.513834 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.513927 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.514130 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.514214 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.514434 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.514561 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.514771 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.514863 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.515073 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.515175 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.515374 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.515466 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.515675 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.515769 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.515969 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.516053 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.516277 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.516363 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.516574 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.516667 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.516872 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.516964 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.517165 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.517249 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.517462 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.517549 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.517758 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.517848 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.518055 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.518140 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.518351 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.518437 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.518646 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.518762 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.518959 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.519044 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.519262 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.519347 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.519567 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.519660 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.520137 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.520227 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.520436 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.520524 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.520732 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.520823 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.521030 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.521131 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.521329 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.521414 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.521628 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.521714 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.521928 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.522022 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.522224 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.522309 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.522521 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.522613 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.522839 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.522935 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.523149 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.523235 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.523464 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.523548 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.523767 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.523860 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.524070 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.524155 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.524370 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.524455 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.524676 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.524760 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:35:46.524983 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.525069 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.525295 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.525381 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.525608 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.525694 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.525931 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.526051 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.526265 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.526351 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.526576 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.526797 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.526919 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.527118 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.527226 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.527429 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.527539 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.527741 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.527860 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.528064 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.528177 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.528374 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.528483 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.528683 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.528821 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.528997 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.529159 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.529312 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.529467 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.529626 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.529788 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.529950 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.530102 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.530271 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.530408 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.530588 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.530735 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.530930 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.531049 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.531240 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.531364 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.531554 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.531671 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.531880 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.531965 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.532198 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.532284 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.532510 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.532596 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.532849 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.532942 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.533149 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.533243 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.533454 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.533539 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.533779 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.533873 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.534087 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.534174 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.534392 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.534483 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.534722 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.534824 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.535026 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.535145 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.535330 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.535417 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.535635 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.535729 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.535938 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.536023 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.536235 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.536320 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.536533 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.536626 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.536830 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.536916 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.537132 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.537217 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.537428 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.537566 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.537739 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.537831 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.538057 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.538149 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.538356 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.538443 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.538685 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.538781 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.538989 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.539087 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.539296 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.539394 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.539599 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.539683 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.539897 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.539981 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.540202 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.540287 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.540504 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.540589 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.540802 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.540885 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.541110 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.541203 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.541410 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.541494 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.542243 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.542347 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.542563 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.542651 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.542898 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.542997 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.543199 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.543293 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.543505 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.543598 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.543811 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.543897 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.544115 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.544209 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.544415 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.544499 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.544726 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.544819 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.545031 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.545133 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.545329 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.545413 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.545649 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.545738 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.545954 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.546046 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.546254 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.546350 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.546574 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.546779 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.546899 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.546988 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.547190 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.547276 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.547498 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.547625 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.547801 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.547886 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.548102 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.548187 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.548401 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.548486 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.548705 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.548792 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.549003 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.549089 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.549355 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.549453 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.549593 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.549679 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.549891 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.549977 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.550194 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.550280 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.550508 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.550595 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.550845 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.550942 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.551145 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.551243 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.551444 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.551530 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.551740 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.551826 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.552041 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.552138 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.552343 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.552434 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.552650 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.552736 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.552952 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.553045 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.553254 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.553346 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.553553 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.553638 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.553854 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.553948 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.554157 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.554244 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.554476 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.554561 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.554805 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.554906 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.555108 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.555196 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.555409 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.555494 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.555709 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.555802 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.556019 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.556104 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.556333 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.556419 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.556639 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.556725 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.556955 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.557042 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.557806 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.557934 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.558130 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.558217 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.558430 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.558517 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.558766 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.558854 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.559072 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.559159 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.559379 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.559517 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.559704 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.559790 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.560017 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.560103 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.560330 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.560415 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.560639 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.560736 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.560942 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.561045 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.561238 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.561323 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.561533 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.561628 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.561837 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.561922 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.562150 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.562234 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.562447 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.562540 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.562774 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.562863 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.563074 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.563161 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.563378 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.563471 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.563693 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.563779 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.564003 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.564093 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.564308 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.564392 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.564612 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.564697 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.564915 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.564998 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] glance.allowed_direct_url_schemes = [] {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.565218 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.565306 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.565517 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.565608 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.565819 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.565904 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.566124 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.566216 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.566422 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.566506 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.566741 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.566838 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.567047 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.567133 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.567350 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.567434 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.567652 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.567735 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.567954 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.568048 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.568251 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.568336 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.568557 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.568652 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.568859 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.568954 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] glance.allowed_direct_url_schemes = [] {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.569156 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.569248 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.569452 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.569545 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.569758 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.569857 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.570065 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.570158 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.570365 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.570460 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.570717 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.570807 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.571003 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.571090 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.571298 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.571394 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.571596 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.571681 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.571898 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.571990 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.572198 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.572290 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.572495 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.572580 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.572792 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.572893 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.573113 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.573200 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.573410 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.573494 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.573720 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.573811 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.574023 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.574108 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.574330 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.574422 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.574644 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.574794 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.574971 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.575056 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.575271 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.575364 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.575571 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.575663 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.575874 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.575969 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.576180 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.576264 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.576480 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.576565 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.576777 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.576865 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.577075 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.577158 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.577374 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.577471 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.577676 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.577761 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.577978 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.578064 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.578293 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.578476 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.578592 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.578777 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.578920 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.579006 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.579225 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.579387 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.579524 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.579609 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.579827 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.579960 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.580142 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.580277 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.580450 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.580704 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.580839 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.581028 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.581167 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.581334 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.581451 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.581640 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.581735 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.581945 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.582044 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.582253 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.582340 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.582557 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.582643 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.582889 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.582990 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.583197 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.583285 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.583494 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.583580 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.583798 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.583892 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.584096 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.584182 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.584395 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.584661 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.584757 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.584992 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.585077 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.585294 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.585436 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.585587 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.585731 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.585865 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.586003 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.586165 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.586303 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.586464 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.586597 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.586792 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.586923 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.587092 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.587227 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.587397 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.587539 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.587680 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.587820 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.587987 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.588121 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.588267 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.588398 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.589134 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.589338 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.589486 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.589620 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.589752 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.589882 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.590033 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.590166 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.590297 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.590433 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.590609 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.590776 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.590927 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.591071 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.591226 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.591365 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.591529 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.591663 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.591841 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.591987 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.592142 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.592278 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.592452 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.592580 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.592754 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.592883 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.593049 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.593177 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.593349 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.593484 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.593653 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.593782 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.593953 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.594082 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.594248 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.594386 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.594553 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.594706 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.594880 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.595022 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.595186 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.595320 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.595472 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.595603 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.595772 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.595902 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.596070 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.596199 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.596380 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.596508 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.596680 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.596815 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.596978 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.597114 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.597275 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.597403 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.597609 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.597755 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.597890 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.598033 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.598167 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.598298 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.598467 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.598598 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.598797 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.598942 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.599098 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.599231 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.599397 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.599529 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.599692 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.599833 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.599989 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.600078 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.600294 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.600388 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.600594 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.600690 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.600896 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.600982 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.601197 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.601280 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.601503 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.601588 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.601799 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.601883 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.602101 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.602196 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.602397 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.602482 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.602720 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.602810 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.603021 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.603106 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.603319 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.603414 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.603618 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.603701 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.603913 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.603997 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.604269 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.604363 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.604586 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.604671 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.604892 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.604986 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.605194 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.605280 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.605495 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.605582 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.605793 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.605886 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.606129 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.606214 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.606427 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.606513 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.606760 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.606863 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.607068 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.607155 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.607373 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.607458 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.607675 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.607768 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.607980 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.608064 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.608281 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.608365 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.608588 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.608683 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.608895 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.608987 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.609196 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.609280 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.609493 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.609577 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.609790 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.609883 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.610107 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.610248 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.610411 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.610541 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.610744 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.610886 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.611061 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.611190 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.611377 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.611528 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.611691 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.611824 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.611987 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.612119 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.612290 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.612424 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.612596 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.612729 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.612900 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.613030 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.613203 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.613343 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.613486 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.613623 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.613791 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.613933 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.614093 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.614224 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.614397 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.614537 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.614722 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.614885 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.615016 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.615154 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.615320 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.615458 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.615622 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.615768 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.615929 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.616059 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.616230 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.616357 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.616538 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.616676 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.616838 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.616925 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.617136 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.617223 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.617442 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.617535 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.617741 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.617869 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.618047 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.618140 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.618345 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.618438 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.618652 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.618794 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.618984 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.619072 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.619293 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.619380 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.619601 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.620198 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.620442 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.620536 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.620750 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.620909 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.621075 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.621230 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.621383 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.621540 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.621693 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.621841 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.622004 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.622252 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.622338 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.622558 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.622645 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.622890 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.622976 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.623197 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.623332 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.623495 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.623645 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.623791 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.623954 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.624096 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.624258 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.624414 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.624567 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.624711 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.624877 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.625012 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.625191 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.625312 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.625506 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.625628 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.625810 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.625928 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.626228 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.626319 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.626539 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.626624 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.626875 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.626969 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.627188 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.627274 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.627494 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.627656 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.627796 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.627963 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.628107 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.628270 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.628432 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.628587 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.628736 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.628901 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.629040 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.629221 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.629343 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.629521 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.629663 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.629833 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.629967 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.630138 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_usb_tablet = True {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.630277 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.630439 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.630712 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.630815 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.631028 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.631114 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.631334 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.631419 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.631674 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.631771 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.631977 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.632062 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.632293 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.632378 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.632611 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.632776 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.632921 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.633008 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.633236 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.633321 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.633564 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.633656 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.633879 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.633964 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.634188 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_usb_tablet = True {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.634273 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.634500 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.634585 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.xen_hvmloader_path = /usr/lib/xen/boot/hvmloader {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.634847 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.634935 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.635172 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.635268 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.635573 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.635662 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.635936 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.636127 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.636246 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.636447 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.636571 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.636753 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.636894 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.637060 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.637211 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.637379 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.637536 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.637682 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.637954 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.638046 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.638279 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.638377 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.638583 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.638709 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.638911 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.638999 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.xen_hvmloader_path = /usr/lib/xen/boot/hvmloader {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.639210 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.639308 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.639527 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.639626 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.639826 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.639913 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.640127 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.640212 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.640437 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.640534 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.640739 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.640823 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.641046 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.641137 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.641349 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.641441 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.641666 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.641759 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.641970 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.642062 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.642271 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.642366 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.642572 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.642658 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.642895 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.642988 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.643232 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.643390 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.643531 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.643616 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.643845 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.643931 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.644163 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.644255 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.644476 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.644561 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.645034 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.645165 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.645366 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.645454 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.645669 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.645753 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.645982 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.646066 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.646286 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.646371 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.646589 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.646694 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.646918 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.647007 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.647213 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.647299 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.647515 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.647601 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.647813 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.647904 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.648112 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.648198 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.648407 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.648499 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.648708 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.648818 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.649007 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.649102 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.649303 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.649395 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.649599 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.649693 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.649915 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.650006 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.650212 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.650298 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.650525 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.650619 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.650852 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.651446 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.651679 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.651845 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.651982 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.652202 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.652365 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.652506 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.652706 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.652814 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.653004 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.653117 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.653331 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.653441 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.653643 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.653736 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.653959 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.654048 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.654280 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.654366 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.654585 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.654695 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.654911 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.654996 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.655225 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.655309 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.655528 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.655614 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.655831 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.655924 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.656133 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.656221 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.656430 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.656516 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.656736 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.656828 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.657044 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.657130 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.657346 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.657463 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.657655 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.657740 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.657963 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.658049 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.658272 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.658366 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.658582 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.658810 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.658926 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.659136 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.659223 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.659462 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.driver = filter_scheduler {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.659557 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.659768 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.659854 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.660076 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.660170 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.660382 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.660469 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.660693 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.660778 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.660998 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.661095 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.661303 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.periodic_task_interval = 60 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.661389 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.661611 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.661696 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.661914 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.662063 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.662200 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.662340 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.662523 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.662754 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.662888 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.663081 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.663226 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.663410 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.driver = filter_scheduler {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.663548 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.663721 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.663863 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.664030 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.664161 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.664340 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.664471 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.664658 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.664799 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.664968 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.665098 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.665278 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.periodic_task_interval = 60 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.665408 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.665585 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.665723 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.665893 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.666024 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.666201 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.666334 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.666510 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.666757 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.666991 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.667129 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.667327 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.667445 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.667634 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.667727 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.667946 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.668034 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.668255 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.668344 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.668560 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.668656 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.668868 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.668955 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.669176 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.669288 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.669498 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.669585 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.669811 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.669904 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.670126 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.670222 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.670431 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.670516 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.670761 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.670852 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.671073 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.671169 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.671381 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.671588 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.671675 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.671903 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.672057 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.672229 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.672360 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.672545 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.672682 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.672863 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.673077 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.673211 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.673355 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.673489 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.673622 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.673756 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.673897 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.674031 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.674164 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.674323 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.674452 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.674626 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.674831 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.674974 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.675108 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.675240 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.675527 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.675667 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.675829 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.675966 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.676128 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.676275 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.676439 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.676578 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.676740 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.676829 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.677097 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.677269 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.677415 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.677612 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.677746 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.677925 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.678080 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.678247 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.678390 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.678594 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.678775 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.678905 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.679049 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.679191 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.679329 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.679463 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.679595 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.679763 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.679897 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.680064 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.680206 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.680371 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.680510 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.680675 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.680807 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.680971 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.681203 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.681337 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.681543 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.681629 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.681855 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.681949 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.682154 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.682873 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.683003 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.683121 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.683304 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.683403 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.683636 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.683720 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.683957 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.684043 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.684262 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.684356 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.684567 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.684662 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.684871 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.684962 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.685170 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.685268 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.685467 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.685554 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.685765 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.685850 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.686062 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.686156 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.686367 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.686452 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.686676 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.686763 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.686987 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.687072 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.687283 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.687368 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.687587 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.687674 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.687884 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.687971 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.688181 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.688266 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.688477 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.688563 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.688782 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.688877 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.689081 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.689165 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.689376 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.689461 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.689677 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.689771 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.689978 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.690064 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.690285 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.690373 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.690586 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.690727 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.690914 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.691002 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.691215 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.691308 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.691523 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.691609 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.691824 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.692060 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.692190 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.692388 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.692475 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.692702 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.692796 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.693011 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.693102 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.693312 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.693399 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.693623 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.693710 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.693932 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.694018 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.694227 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.694313 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.694542 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.694628 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.694870 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.694955 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.695174 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.695260 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.695476 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.695563 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.695781 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.696028 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.696115 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.696363 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.696492 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.696663 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.696748 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.696966 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.697060 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.697267 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.697353 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.697569 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.697699 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.697953 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.698043 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.698298 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.698620 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.698737 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.698956 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.699071 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.699266 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.699393 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.699575 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.699696 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.699883 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.700012 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.700189 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.700321 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.700497 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.700628 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.700806 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.700934 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.701112 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.701241 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.701419 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.701554 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.701727 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.701879 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.702039 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.702194 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.702495 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.702644 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.702878 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.702973 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.703197 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.703284 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.703515 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.703609 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.703829 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.703921 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.704138 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.704231 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.704443 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.704540 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.704750 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.704837 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.705060 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.705146 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.705376 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.705469 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.705678 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.705763 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.705976 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.706062 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.706274 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.706361 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.706579 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.706714 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.706931 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.707017 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.707240 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.707334 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.707554 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.707641 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.707859 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.707945 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.708173 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.708260 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.708476 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.708562 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.708788 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.708883 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.709102 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.709189 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.709410 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.709496 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.709712 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.709809 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.710021 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.710105 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.710329 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.710422 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.710630 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.710749 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.710958 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.711052 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.711262 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.711361 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.711566 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.711661 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.711870 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.711957 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.712178 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.712263 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.712502 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.712592 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.712801 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.712895 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.713117 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.713202 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.713423 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.714062 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.714248 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.714375 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.714615 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.714731 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.714887 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.714974 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.715193 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.715278 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.715499 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.715592 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.715804 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.715888 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.716102 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.716187 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.716404 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.716499 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.716714 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.716801 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.717016 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.717108 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.717331 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.717429 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.717640 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.717725 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.717952 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.718036 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.718262 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.718354 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.718571 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.718657 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.718914 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.718999 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.719219 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.719304 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.719531 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.719617 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.719776 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=82458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 08 02:35:46.719863 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.720131 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.720442 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.720753 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.721076 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.721396 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.721715 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.722035 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.722376 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.722710 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.723059 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.723385 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:35:46.723625 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=82457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 08 02:35:46.755289 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG oslo_db.sqlalchemy.engines [None req-2a12d831-4653-4d6d-8dbc-594be721a24a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82458) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 08 02:35:46.756154 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG oslo_db.sqlalchemy.engines [None req-c2a506e4-ffd5-4bda-ae42-9da85f405a49 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82457) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 08 02:35:46.996107 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.context [None req-2a12d831-4653-4d6d-8dbc-594be721a24a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6d23fd24-1ab4-4f74-87ff-4e24114caf2e(cell1) {{(pid=82458) load_cells /opt/stack/nova/nova/context.py:465}} Apr 08 02:35:46.999781 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.context [None req-c2a506e4-ffd5-4bda-ae42-9da85f405a49 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6d23fd24-1ab4-4f74-87ff-4e24114caf2e(cell1) {{(pid=82457) load_cells /opt/stack/nova/nova/context.py:465}} Apr 08 02:35:46.999905 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG oslo_concurrency.lockutils [None req-2a12d831-4653-4d6d-8dbc-594be721a24a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:35:47.001463 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG oslo_concurrency.lockutils [None req-2a12d831-4653-4d6d-8dbc-594be721a24a None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=82458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:35:47.002255 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG oslo_concurrency.lockutils [None req-2a12d831-4653-4d6d-8dbc-594be721a24a None None] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:35:47.003952 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG oslo_concurrency.lockutils [None req-c2a506e4-ffd5-4bda-ae42-9da85f405a49 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:35:47.004202 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG oslo_concurrency.lockutils [None req-2a12d831-4653-4d6d-8dbc-594be721a24a None None] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=82458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:35:47.005631 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG oslo_concurrency.lockutils [None req-c2a506e4-ffd5-4bda-ae42-9da85f405a49 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=82457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:35:47.006360 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG oslo_concurrency.lockutils [None req-c2a506e4-ffd5-4bda-ae42-9da85f405a49 None None] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:35:47.008316 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG oslo_concurrency.lockutils [None req-c2a506e4-ffd5-4bda-ae42-9da85f405a49 None None] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=82457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:35:47.029379 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG oslo_db.sqlalchemy.engines [None req-2a12d831-4653-4d6d-8dbc-594be721a24a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82458) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 08 02:35:47.035087 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG oslo_db.sqlalchemy.engines [None req-2a12d831-4653-4d6d-8dbc-594be721a24a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82458) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 08 02:35:47.040169 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG oslo_db.sqlalchemy.engines [None req-c2a506e4-ffd5-4bda-ae42-9da85f405a49 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82457) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 08 02:35:47.041217 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG oslo_db.sqlalchemy.engines [None req-c2a506e4-ffd5-4bda-ae42-9da85f405a49 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82457) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 08 02:35:47.063731 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG oslo_db.sqlalchemy.engines [None req-2a12d831-4653-4d6d-8dbc-594be721a24a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82458) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 08 02:35:47.072008 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG oslo_db.sqlalchemy.engines [None req-c2a506e4-ffd5-4bda-ae42-9da85f405a49 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82457) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 08 02:35:47.224833 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: INFO keyring.backend [None req-2a12d831-4653-4d6d-8dbc-594be721a24a None None] Loading KWallet Apr 08 02:35:47.227618 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: INFO keyring.backend [None req-c2a506e4-ffd5-4bda-ae42-9da85f405a49 None None] Loading KWallet Apr 08 02:35:47.234481 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: INFO keyring.backend [None req-2a12d831-4653-4d6d-8dbc-594be721a24a None None] Loading SecretService Apr 08 02:35:47.236951 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: INFO keyring.backend [None req-c2a506e4-ffd5-4bda-ae42-9da85f405a49 None None] Loading SecretService Apr 08 02:35:47.238452 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: INFO keyring.backend [None req-2a12d831-4653-4d6d-8dbc-594be721a24a None None] Loading Windows Apr 08 02:35:47.240294 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: INFO keyring.backend [None req-2a12d831-4653-4d6d-8dbc-594be721a24a None None] Loading chainer Apr 08 02:35:47.240803 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: INFO keyring.backend [None req-c2a506e4-ffd5-4bda-ae42-9da85f405a49 None None] Loading Windows Apr 08 02:35:47.241083 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: INFO keyring.backend [None req-2a12d831-4653-4d6d-8dbc-594be721a24a None None] Loading macOS Apr 08 02:35:47.242623 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: INFO keyring.backend [None req-c2a506e4-ffd5-4bda-ae42-9da85f405a49 None None] Loading chainer Apr 08 02:35:47.243443 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: INFO keyring.backend [None req-c2a506e4-ffd5-4bda-ae42-9da85f405a49 None None] Loading macOS Apr 08 02:35:47.584571 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: WARNING keystonemiddleware.auth_token [None req-2a12d831-4653-4d6d-8dbc-594be721a24a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 08 02:35:47.586614 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: WARNING keystonemiddleware.auth_token [None req-c2a506e4-ffd5-4bda-ae42-9da85f405a49 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 08 02:35:47.591910 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: WARNING keystonemiddleware.auth_token [None req-2a12d831-4653-4d6d-8dbc-594be721a24a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 08 02:35:47.593537 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: WARNING keystonemiddleware.auth_token [None req-c2a506e4-ffd5-4bda-ae42-9da85f405a49 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 08 02:35:47.799542 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: WARNING keystonemiddleware.auth_token [None req-2a12d831-4653-4d6d-8dbc-594be721a24a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 08 02:35:47.804546 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: WARNING keystonemiddleware.auth_token [None req-2a12d831-4653-4d6d-8dbc-594be721a24a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 08 02:35:47.804801 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: WARNING keystonemiddleware.auth_token [None req-c2a506e4-ffd5-4bda-ae42-9da85f405a49 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 08 02:35:47.809813 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5615903c29c0 pid: 82458 (default app) Apr 08 02:35:47.809919 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: WARNING keystonemiddleware.auth_token [None req-c2a506e4-ffd5-4bda-ae42-9da85f405a49 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 08 02:35:47.811868 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi [None req-2a12d831-4653-4d6d-8dbc-594be721a24a None None] Calling method '>' {{(pid=82458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:35:47.812958 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: INFO nova.api.openstack.requestlog [None req-2a12d831-4653-4d6d-8dbc-594be721a24a None None] 10.222.0.48 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001614 Apr 08 02:35:47.813376 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: [pid: 82458|app: 0|req: 1/1] 10.222.0.48 () {50 vars in 788 bytes} [Fri Apr 8 02:35:47 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:35:47.815067 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5615903c29c0 pid: 82457 (default app) Apr 08 02:37:04.875479 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi [None req-7d96ab83-f79a-4810-8928-17f73bb80f46 admin admin] Calling method '>' {{(pid=82458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:37:04.898232 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: INFO nova.api.openstack.requestlog [None req-7d96ab83-f79a-4810-8928-17f73bb80f46 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 15 microversion: 2.1 time: 0.460089 Apr 08 02:37:04.899323 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: [pid: 82458|app: 0|req: 2/2] 10.222.0.48 () {58 vars in 1159 bytes} [Fri Apr 8 02:37:04 2022] GET /compute/v2.1/flavors/detail => generated 15 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 08 02:37:07.264135 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi [None req-9e99f090-03a4-48bb-82f5-d5cd3394a6e7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "ram": 256, "vcpus": 1, "disk": 1, "id": "c1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=82457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:37:07.287177 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:37:07.287177 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: warnings.warn(msg) Apr 08 02:37:07.314865 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: INFO nova.api.openstack.requestlog [None req-9e99f090-03a4-48bb-82f5-d5cd3394a6e7 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 367 microversion: 2.1 time: 0.367650 Apr 08 02:37:07.315424 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: [pid: 82457|app: 0|req: 1/3] 10.222.0.48 () {62 vars in 1192 bytes} [Fri Apr 8 02:37:06 2022] POST /compute/v2.1/flavors => generated 367 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:37:07.331021 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi [None req-683aa1fe-9bc4-44e8-86e7-4fa467662655 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=82458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:37:07.337959 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:37:07.337959 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: warnings.warn(msg) Apr 08 02:37:07.375187 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: INFO nova.api.openstack.requestlog [None req-683aa1fe-9bc4-44e8-86e7-4fa467662655 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.052901 Apr 08 02:37:07.375740 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: [pid: 82458|app: 0|req: 3/4] 10.222.0.48 () {62 vars in 1245 bytes} [Fri Apr 8 02:37:07 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 08 02:37:07.390977 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi [None req-344da29f-85cc-4393-8304-a68e5e5215a0 admin admin] Calling method '>' {{(pid=82457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:37:07.413789 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: INFO nova.api.openstack.requestlog [None req-344da29f-85cc-4393-8304-a68e5e5215a0 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.032351 Apr 08 02:37:07.415490 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: [pid: 82457|app: 0|req: 2/5] 10.222.0.48 () {58 vars in 1192 bytes} [Fri Apr 8 02:37:07 2022] GET /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 08 02:37:09.600140 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi [None req-2dece296-8eb5-40f3-8fb6-e6eb008df4b4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "ram": 512, "vcpus": 1, "disk": 5, "id": "d1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=82458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:37:09.623310 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:37:09.623310 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: warnings.warn(msg) Apr 08 02:37:09.646237 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: INFO nova.api.openstack.requestlog [None req-2dece296-8eb5-40f3-8fb6-e6eb008df4b4 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 364 microversion: 2.1 time: 0.122766 Apr 08 02:37:09.646832 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: [pid: 82458|app: 0|req: 4/6] 10.222.0.48 () {62 vars in 1192 bytes} [Fri Apr 8 02:37:09 2022] POST /compute/v2.1/flavors => generated 364 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:37:09.661658 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi [None req-7290fcee-dfde-4f83-9a06-70bf04daa5a1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=82457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:37:09.668231 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:37:09.668231 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: warnings.warn(msg) Apr 08 02:37:09.703774 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: INFO nova.api.openstack.requestlog [None req-7290fcee-dfde-4f83-9a06-70bf04daa5a1 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.050487 Apr 08 02:37:09.704371 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: [pid: 82457|app: 0|req: 3/7] 10.222.0.48 () {62 vars in 1245 bytes} [Fri Apr 8 02:37:09 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 08 02:37:09.718539 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi [None req-6d08cd20-6ec3-42b9-9528-c85f36c2d640 admin admin] Calling method '>' {{(pid=82458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:37:09.849733 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: INFO nova.api.openstack.requestlog [None req-6d08cd20-6ec3-42b9-9528-c85f36c2d640 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.139486 Apr 08 02:37:09.850298 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: [pid: 82458|app: 0|req: 5/8] 10.222.0.48 () {58 vars in 1192 bytes} [Fri Apr 8 02:37:09 2022] GET /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 08 02:37:12.065037 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi [None req-34a3d801-72dd-45ff-b5e6-cefc78b83a76 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "ram": 1024, "vcpus": 1, "disk": 10, "id": "d2", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=82457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:37:12.204230 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: INFO nova.api.openstack.requestlog [None req-34a3d801-72dd-45ff-b5e6-cefc78b83a76 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 364 microversion: 2.1 time: 0.218184 Apr 08 02:37:12.204705 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: [pid: 82457|app: 0|req: 4/9] 10.222.0.48 () {62 vars in 1192 bytes} [Fri Apr 8 02:37:11 2022] POST /compute/v2.1/flavors => generated 364 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:37:12.219822 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi [None req-97871adc-3853-4c0e-9f54-d243371ef593 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=82458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:37:12.258062 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: INFO nova.api.openstack.requestlog [None req-97871adc-3853-4c0e-9f54-d243371ef593 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.047176 Apr 08 02:37:12.258615 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: [pid: 82458|app: 0|req: 6/10] 10.222.0.48 () {62 vars in 1245 bytes} [Fri Apr 8 02:37:12 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 08 02:37:12.272542 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi [None req-d46c1572-01f3-4cc8-98a4-fbffcb7e0512 admin admin] Calling method '>' {{(pid=82457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:37:12.292160 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: INFO nova.api.openstack.requestlog [None req-d46c1572-01f3-4cc8-98a4-fbffcb7e0512 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.028118 Apr 08 02:37:12.292683 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: [pid: 82457|app: 0|req: 5/11] 10.222.0.48 () {58 vars in 1192 bytes} [Fri Apr 8 02:37:12 2022] GET /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 08 02:37:14.461080 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi [None req-3399ee30-94d3-4d14-b667-73ec3e04880c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "ram": 2048, "vcpus": 2, "disk": 10, "id": "d3", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=82458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:37:14.486706 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: INFO nova.api.openstack.requestlog [None req-3399ee30-94d3-4d14-b667-73ec3e04880c admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 364 microversion: 2.1 time: 0.102119 Apr 08 02:37:14.487254 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: [pid: 82458|app: 0|req: 7/12] 10.222.0.48 () {62 vars in 1192 bytes} [Fri Apr 8 02:37:14 2022] POST /compute/v2.1/flavors => generated 364 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 02:37:14.502878 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi [None req-50a82f10-ba31-4c33-b7fc-80545f6face0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=82457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:37:14.543264 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: INFO nova.api.openstack.requestlog [None req-50a82f10-ba31-4c33-b7fc-80545f6face0 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.048807 Apr 08 02:37:14.543759 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: [pid: 82457|app: 0|req: 6/13] 10.222.0.48 () {62 vars in 1245 bytes} [Fri Apr 8 02:37:14 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 08 02:37:14.557904 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi [None req-74b230e5-24c1-4ed8-9be0-00ddf3a4f636 admin admin] Calling method '>' {{(pid=82458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:37:14.577121 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: INFO nova.api.openstack.requestlog [None req-74b230e5-24c1-4ed8-9be0-00ddf3a4f636 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.027955 Apr 08 02:37:14.577628 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: [pid: 82458|app: 0|req: 8/14] 10.222.0.48 () {58 vars in 1192 bytes} [Fri Apr 8 02:37:14 2022] GET /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 08 02:37:16.779687 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi [None req-02303b9c-686a-4841-82e3-60e5ba4c4034 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "ram": 4096, "vcpus": 4, "disk": 20, "id": "d4", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=82457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:37:16.808489 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: INFO nova.api.openstack.requestlog [None req-02303b9c-686a-4841-82e3-60e5ba4c4034 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 364 microversion: 2.1 time: 0.123904 Apr 08 02:37:16.809055 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: [pid: 82457|app: 0|req: 7/15] 10.222.0.48 () {62 vars in 1192 bytes} [Fri Apr 8 02:37:16 2022] POST /compute/v2.1/flavors => generated 364 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:37:16.824663 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi [None req-9e56f2f3-10f1-454f-89e7-8fc6109cf61c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=82458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:37:16.865639 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: INFO nova.api.openstack.requestlog [None req-9e56f2f3-10f1-454f-89e7-8fc6109cf61c admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.050254 Apr 08 02:37:16.866224 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: [pid: 82458|app: 0|req: 9/16] 10.222.0.48 () {62 vars in 1245 bytes} [Fri Apr 8 02:37:16 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 08 02:37:16.881553 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi [None req-19943d30-3110-480e-a4ce-fc42125b8a60 admin admin] Calling method '>' {{(pid=82457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:37:16.903398 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: INFO nova.api.openstack.requestlog [None req-19943d30-3110-480e-a4ce-fc42125b8a60 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.030343 Apr 08 02:37:16.903957 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: [pid: 82457|app: 0|req: 8/17] 10.222.0.48 () {58 vars in 1192 bytes} [Fri Apr 8 02:37:16 2022] GET /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 08 02:37:19.087933 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi [None req-dcd6f836-4d14-4c1a-a70d-b70047887818 admin admin] Calling method '>' {{(pid=82458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:37:19.105887 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: INFO nova.api.openstack.requestlog [None req-dcd6f836-4d14-4c1a-a70d-b70047887818 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 1786 microversion: 2.1 time: 0.096090 Apr 08 02:37:19.106433 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: [pid: 82458|app: 0|req: 10/18] 10.222.0.48 () {58 vars in 1159 bytes} [Fri Apr 8 02:37:19 2022] GET /compute/v2.1/flavors/detail => generated 1786 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:37:21.300071 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi [None req-c90d419d-dea5-496b-9f18-eb1d03d65847 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "ram": 512, "vcpus": 1, "disk": 1, "id": "1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=82457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:37:21.325837 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: INFO nova.api.openstack.requestlog [None req-c90d419d-dea5-496b-9f18-eb1d03d65847 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 362 microversion: 2.1 time: 0.103763 Apr 08 02:37:21.326382 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: [pid: 82457|app: 0|req: 9/19] 10.222.0.48 () {62 vars in 1192 bytes} [Fri Apr 8 02:37:21 2022] POST /compute/v2.1/flavors => generated 362 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:37:21.341286 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi [None req-108d7cc7-6875-4e4f-9e70-5dc3b4bca766 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=82458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:37:21.379445 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: INFO nova.api.openstack.requestlog [None req-108d7cc7-6875-4e4f-9e70-5dc3b4bca766 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.046895 Apr 08 02:37:21.379993 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: [pid: 82458|app: 0|req: 11/20] 10.222.0.48 () {62 vars in 1242 bytes} [Fri Apr 8 02:37:21 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 08 02:37:21.393809 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi [None req-78b02057-26b7-48ea-9b1a-3872167b908a admin admin] Calling method '>' {{(pid=82457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:37:21.413100 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: INFO nova.api.openstack.requestlog [None req-78b02057-26b7-48ea-9b1a-3872167b908a admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.027489 Apr 08 02:37:21.413614 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: [pid: 82457|app: 0|req: 10/21] 10.222.0.48 () {58 vars in 1189 bytes} [Fri Apr 8 02:37:21 2022] GET /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 08 02:37:23.553123 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi [None req-f504257b-717d-410f-b6ec-cdf53d2bebd1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "ram": 2048, "vcpus": 1, "disk": 20, "id": "2", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=82458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:37:23.578894 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: INFO nova.api.openstack.requestlog [None req-f504257b-717d-410f-b6ec-cdf53d2bebd1 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 365 microversion: 2.1 time: 0.104188 Apr 08 02:37:23.579449 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: [pid: 82458|app: 0|req: 12/22] 10.222.0.48 () {62 vars in 1192 bytes} [Fri Apr 8 02:37:23 2022] POST /compute/v2.1/flavors => generated 365 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:37:23.594801 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi [None req-aa48f589-aeac-447e-94af-3ceea5049765 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=82457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:37:23.633457 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: INFO nova.api.openstack.requestlog [None req-aa48f589-aeac-447e-94af-3ceea5049765 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.047710 Apr 08 02:37:23.633901 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: [pid: 82457|app: 0|req: 11/23] 10.222.0.48 () {62 vars in 1242 bytes} [Fri Apr 8 02:37:23 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 08 02:37:23.647893 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi [None req-4ab30c09-b59c-421e-acac-35a6541a6382 admin admin] Calling method '>' {{(pid=82458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:37:23.667084 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: INFO nova.api.openstack.requestlog [None req-4ab30c09-b59c-421e-acac-35a6541a6382 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.027578 Apr 08 02:37:23.667602 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: [pid: 82458|app: 0|req: 13/24] 10.222.0.48 () {58 vars in 1189 bytes} [Fri Apr 8 02:37:23 2022] GET /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 08 02:37:25.890595 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi [None req-59249d7a-3379-4a38-9009-363e28a011b9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "ram": 4096, "vcpus": 2, "disk": 40, "id": "3", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=82457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:37:25.918090 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: INFO nova.api.openstack.requestlog [None req-59249d7a-3379-4a38-9009-363e28a011b9 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 366 microversion: 2.1 time: 0.106991 Apr 08 02:37:25.918645 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: [pid: 82457|app: 0|req: 12/25] 10.222.0.48 () {62 vars in 1192 bytes} [Fri Apr 8 02:37:25 2022] POST /compute/v2.1/flavors => generated 366 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:37:25.933313 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi [None req-4c326337-ba44-4221-9d56-b2389dce3ee5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=82458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:37:25.973222 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: INFO nova.api.openstack.requestlog [None req-4c326337-ba44-4221-9d56-b2389dce3ee5 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.048062 Apr 08 02:37:25.973720 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: [pid: 82458|app: 0|req: 14/26] 10.222.0.48 () {62 vars in 1242 bytes} [Fri Apr 8 02:37:25 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 08 02:37:25.988163 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi [None req-3242953e-e97f-4c23-8c54-9f3a41e0aecf admin admin] Calling method '>' {{(pid=82457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:37:26.007742 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: INFO nova.api.openstack.requestlog [None req-3242953e-e97f-4c23-8c54-9f3a41e0aecf admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.028155 Apr 08 02:37:26.009308 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: [pid: 82457|app: 0|req: 13/27] 10.222.0.48 () {58 vars in 1189 bytes} [Fri Apr 8 02:37:25 2022] GET /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 08 02:37:28.147749 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi [None req-81d30ef4-12a6-402d-9821-e5134a22dfd5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "ram": 8192, "vcpus": 4, "disk": 80, "id": "4", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=82458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:37:28.174806 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: INFO nova.api.openstack.requestlog [None req-81d30ef4-12a6-402d-9821-e5134a22dfd5 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 365 microversion: 2.1 time: 0.104401 Apr 08 02:37:28.175359 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: [pid: 82458|app: 0|req: 15/28] 10.222.0.48 () {62 vars in 1192 bytes} [Fri Apr 8 02:37:28 2022] POST /compute/v2.1/flavors => generated 365 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:37:28.190162 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi [None req-f10c8dbc-1535-436b-b683-e2df970dbc17 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=82457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:37:28.229078 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: INFO nova.api.openstack.requestlog [None req-f10c8dbc-1535-436b-b683-e2df970dbc17 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.047528 Apr 08 02:37:28.229622 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: [pid: 82457|app: 0|req: 14/29] 10.222.0.48 () {62 vars in 1242 bytes} [Fri Apr 8 02:37:28 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 08 02:37:28.244306 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi [None req-dd83e325-d6e7-40cf-8fa8-6d53a5c8e2bd admin admin] Calling method '>' {{(pid=82458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:37:28.263319 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: INFO nova.api.openstack.requestlog [None req-dd83e325-d6e7-40cf-8fa8-6d53a5c8e2bd admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.028331 Apr 08 02:37:28.263841 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: [pid: 82458|app: 0|req: 16/30] 10.222.0.48 () {58 vars in 1189 bytes} [Fri Apr 8 02:37:28 2022] GET /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 08 02:37:30.409600 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi [None req-39faddb8-63e0-416b-b5db-7d4354142544 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "ram": 16384, "vcpus": 8, "disk": 160, "id": "5", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=82457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:37:30.435744 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: INFO nova.api.openstack.requestlog [None req-39faddb8-63e0-416b-b5db-7d4354142544 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 368 microversion: 2.1 time: 0.104365 Apr 08 02:37:30.436288 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: [pid: 82457|app: 0|req: 15/31] 10.222.0.48 () {62 vars in 1192 bytes} [Fri Apr 8 02:37:30 2022] POST /compute/v2.1/flavors => generated 368 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 02:37:30.452550 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi [None req-fa24cfaa-bdd9-411d-ac67-3d315d01527a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=82458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:37:30.493313 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: INFO nova.api.openstack.requestlog [None req-fa24cfaa-bdd9-411d-ac67-3d315d01527a admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.050056 Apr 08 02:37:30.493812 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: [pid: 82458|app: 0|req: 17/32] 10.222.0.48 () {62 vars in 1242 bytes} [Fri Apr 8 02:37:30 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 08 02:37:30.507909 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi [None req-15fcc1dd-2973-48f3-8a6c-8da8a6817063 admin admin] Calling method '>' {{(pid=82457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:37:30.529027 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: INFO nova.api.openstack.requestlog [None req-15fcc1dd-2973-48f3-8a6c-8da8a6817063 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.029545 Apr 08 02:37:30.529552 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: [pid: 82457|app: 0|req: 16/33] 10.222.0.48 () {58 vars in 1189 bytes} [Fri Apr 8 02:37:30 2022] GET /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 08 02:38:37.533219 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi [None req-976fdf18-58a7-4d08-949c-faccec7adc7a admin admin] Calling method '>' {{(pid=82458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:38:37.554272 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: INFO nova.api.openstack.requestlog [None req-976fdf18-58a7-4d08-949c-faccec7adc7a admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 3562 microversion: 2.1 time: 0.099020 Apr 08 02:38:37.554841 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: [pid: 82458|app: 0|req: 18/34] 10.222.0.48 () {58 vars in 1159 bytes} [Fri Apr 8 02:38:37 2022] GET /compute/v2.1/flavors/detail => generated 3562 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:38:38.977623 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi [None req-15fcc1dd-2973-48f3-8a6c-8da8a6817063 admin admin] Calling method '>' {{(pid=82457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:38:38.978608 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: INFO nova.api.openstack.requestlog [None req-15fcc1dd-2973-48f3-8a6c-8da8a6817063 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001390 Apr 08 02:38:38.979032 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: [pid: 82457|app: 0|req: 17/35] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Apr 8 02:38:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:38:39.208545 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi [None req-74992f1b-679d-4763-90bb-8f66e42cebcd admin admin] Calling method '>' {{(pid=82458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:38:39.220712 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: INFO nova.api.openstack.wsgi [None req-74992f1b-679d-4763-90bb-8f66e42cebcd admin admin] HTTP exception thrown: Flavor 42 could not be found. Apr 08 02:38:39.221273 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi [None req-74992f1b-679d-4763-90bb-8f66e42cebcd admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=82458) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Apr 08 02:38:39.222047 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: INFO nova.api.openstack.requestlog [None req-74992f1b-679d-4763-90bb-8f66e42cebcd admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.87 time: 0.091155 Apr 08 02:38:39.222550 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: [pid: 82458|app: 0|req: 19/36] 10.222.0.48 () {60 vars in 1190 bytes} [Fri Apr 8 02:38:39 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 08 02:38:39.236820 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi [None req-8dc0888e-6287-4353-9c55-caeb6f9cb97d admin admin] Calling method '>' {{(pid=82457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:38:39.257579 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: INFO nova.api.openstack.requestlog [None req-8dc0888e-6287-4353-9c55-caeb6f9cb97d admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.029470 Apr 08 02:38:39.258104 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: [pid: 82457|app: 0|req: 18/37] 10.222.0.48 () {60 vars in 1210 bytes} [Fri Apr 8 02:38:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:38:39.273500 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi [None req-085230d9-3e2a-4a4b-8bfc-320319471efa admin admin] Calling method '>' {{(pid=82458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:38:39.293145 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: INFO nova.api.openstack.requestlog [None req-085230d9-3e2a-4a4b-8bfc-320319471efa admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.028079 Apr 08 02:38:39.293663 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: [pid: 82458|app: 0|req: 20/38] 10.222.0.48 () {60 vars in 1210 bytes} [Fri Apr 8 02:38:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 02:38:39.307411 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi [None req-8ccbbf87-d367-433a-8670-34d2e65088d1 admin admin] Calling method '>' {{(pid=82457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:38:39.319833 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: INFO nova.api.openstack.wsgi [None req-8ccbbf87-d367-433a-8670-34d2e65088d1 admin admin] HTTP exception thrown: Flavor 42 could not be found. Apr 08 02:38:39.320397 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi [None req-8ccbbf87-d367-433a-8670-34d2e65088d1 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=82457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Apr 08 02:38:39.321171 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: INFO nova.api.openstack.requestlog [None req-8ccbbf87-d367-433a-8670-34d2e65088d1 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.87 time: 0.021993 Apr 08 02:38:39.321657 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: [pid: 82457|app: 0|req: 19/39] 10.222.0.48 () {60 vars in 1190 bytes} [Fri Apr 8 02:38:39 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Apr 08 02:38:40.674457 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi [None req-085230d9-3e2a-4a4b-8bfc-320319471efa admin admin] Calling method '>' {{(pid=82458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:38:40.675570 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: INFO nova.api.openstack.requestlog [None req-085230d9-3e2a-4a4b-8bfc-320319471efa admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 Apr 08 02:38:40.675959 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: [pid: 82458|app: 0|req: 21/40] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Apr 8 02:38:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:38:40.890602 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi [None req-dfa8c965-3109-4ce8-b3b9-b3bba510ce6c admin admin] Calling method '>' {{(pid=82457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:38:40.903233 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: INFO nova.api.openstack.wsgi [None req-dfa8c965-3109-4ce8-b3b9-b3bba510ce6c admin admin] HTTP exception thrown: Flavor 84 could not be found. Apr 08 02:38:40.903799 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi [None req-dfa8c965-3109-4ce8-b3b9-b3bba510ce6c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=82457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Apr 08 02:38:40.904585 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: INFO nova.api.openstack.requestlog [None req-dfa8c965-3109-4ce8-b3b9-b3bba510ce6c admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.87 time: 0.093598 Apr 08 02:38:40.905089 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: [pid: 82457|app: 0|req: 20/41] 10.222.0.48 () {60 vars in 1190 bytes} [Fri Apr 8 02:38:40 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 08 02:38:40.919578 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi [None req-7968d703-3e68-4825-9bc4-af735f40c0fd admin admin] Calling method '>' {{(pid=82458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:38:40.939961 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: INFO nova.api.openstack.requestlog [None req-7968d703-3e68-4825-9bc4-af735f40c0fd admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.029250 Apr 08 02:38:40.940493 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: [pid: 82458|app: 0|req: 22/42] 10.222.0.48 () {60 vars in 1210 bytes} [Fri Apr 8 02:38:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 02:38:40.954551 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi [None req-8f876d8d-810e-4bca-bc81-f81e896cef10 admin admin] Calling method '>' {{(pid=82457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:38:40.974505 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: INFO nova.api.openstack.requestlog [None req-8f876d8d-810e-4bca-bc81-f81e896cef10 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.028147 Apr 08 02:38:40.975065 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: [pid: 82457|app: 0|req: 21/43] 10.222.0.48 () {60 vars in 1210 bytes} [Fri Apr 8 02:38:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 02:38:40.989836 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi [None req-a3caac62-1137-40cd-be92-4b8a177d95a5 admin admin] Calling method '>' {{(pid=82458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:38:41.002394 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: INFO nova.api.openstack.wsgi [None req-a3caac62-1137-40cd-be92-4b8a177d95a5 admin admin] HTTP exception thrown: Flavor 84 could not be found. Apr 08 02:38:41.002989 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi [None req-a3caac62-1137-40cd-be92-4b8a177d95a5 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=82458) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Apr 08 02:38:41.003799 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: INFO nova.api.openstack.requestlog [None req-a3caac62-1137-40cd-be92-4b8a177d95a5 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.87 time: 0.022412 Apr 08 02:38:41.004315 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: [pid: 82458|app: 0|req: 23/44] 10.222.0.48 () {60 vars in 1190 bytes} [Fri Apr 8 02:38:40 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 08 02:38:42.340550 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi [None req-8f876d8d-810e-4bca-bc81-f81e896cef10 admin admin] Calling method '>' {{(pid=82457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:38:42.341546 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: INFO nova.api.openstack.requestlog [None req-8f876d8d-810e-4bca-bc81-f81e896cef10 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Apr 08 02:38:42.341941 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: [pid: 82457|app: 0|req: 22/45] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Apr 8 02:38:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:38:42.560664 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi [None req-b157d4c7-918b-4a2e-a2d6-ae999479fb36 admin admin] Calling method '>' {{(pid=82458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:38:42.572546 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: INFO nova.api.openstack.wsgi [None req-b157d4c7-918b-4a2e-a2d6-ae999479fb36 admin admin] HTTP exception thrown: Flavor 451 could not be found. Apr 08 02:38:42.573105 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi [None req-b157d4c7-918b-4a2e-a2d6-ae999479fb36 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=82458) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Apr 08 02:38:42.573960 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: INFO nova.api.openstack.requestlog [None req-b157d4c7-918b-4a2e-a2d6-ae999479fb36 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.87 time: 0.091656 Apr 08 02:38:42.574456 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: [pid: 82458|app: 0|req: 24/46] 10.222.0.48 () {60 vars in 1193 bytes} [Fri Apr 8 02:38:42 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 08 02:38:42.588124 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi [None req-9b23ed08-3847-4c22-9b23-b00982756338 admin admin] Calling method '>' {{(pid=82457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:38:42.608695 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: INFO nova.api.openstack.requestlog [None req-9b23ed08-3847-4c22-9b23-b00982756338 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.028724 Apr 08 02:38:42.609201 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: [pid: 82457|app: 0|req: 23/47] 10.222.0.48 () {60 vars in 1210 bytes} [Fri Apr 8 02:38:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:38:42.624002 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi [None req-f74373aa-f670-4dfe-ae0c-8462e19c4d7e admin admin] Calling method '>' {{(pid=82458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:38:42.643539 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: INFO nova.api.openstack.requestlog [None req-f74373aa-f670-4dfe-ae0c-8462e19c4d7e admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.028544 Apr 08 02:38:42.644091 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: [pid: 82458|app: 0|req: 25/48] 10.222.0.48 () {60 vars in 1210 bytes} [Fri Apr 8 02:38:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 02:38:42.658418 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi [None req-2e0e0c09-9f4e-4dd2-83db-4204d05c930b admin admin] Calling method '>' {{(pid=82457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:38:42.670773 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: INFO nova.api.openstack.wsgi [None req-2e0e0c09-9f4e-4dd2-83db-4204d05c930b admin admin] HTTP exception thrown: Flavor 451 could not be found. Apr 08 02:38:42.671334 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi [None req-2e0e0c09-9f4e-4dd2-83db-4204d05c930b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=82457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Apr 08 02:38:42.672098 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: INFO nova.api.openstack.requestlog [None req-2e0e0c09-9f4e-4dd2-83db-4204d05c930b admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.87 time: 0.022252 Apr 08 02:38:42.672585 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: [pid: 82457|app: 0|req: 24/49] 10.222.0.48 () {60 vars in 1193 bytes} [Fri Apr 8 02:38:42 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Apr 08 02:38:44.012742 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi [None req-f74373aa-f670-4dfe-ae0c-8462e19c4d7e admin admin] Calling method '>' {{(pid=82458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:38:44.013731 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: INFO nova.api.openstack.requestlog [None req-f74373aa-f670-4dfe-ae0c-8462e19c4d7e admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Apr 08 02:38:44.014121 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: [pid: 82458|app: 0|req: 26/50] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Apr 8 02:38:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:38:44.227782 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi [None req-a20bfe9b-63d6-4d83-999f-0c449e317e27 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=82457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:38:44.260024 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: INFO nova.api.openstack.requestlog [None req-a20bfe9b-63d6-4d83-999f-0c449e317e27 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.87 time: 0.111247 Apr 08 02:38:44.260551 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: [pid: 82457|app: 0|req: 25/51] 10.222.0.48 () {64 vars in 1235 bytes} [Fri Apr 8 02:38:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 02:38:45.600709 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi [None req-f74373aa-f670-4dfe-ae0c-8462e19c4d7e admin admin] Calling method '>' {{(pid=82458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:38:45.601708 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: INFO nova.api.openstack.requestlog [None req-f74373aa-f670-4dfe-ae0c-8462e19c4d7e admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 Apr 08 02:38:45.602111 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: [pid: 82458|app: 0|req: 27/52] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Apr 8 02:38:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:38:45.818528 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi [None req-472a6fed-4b73-4f42-857b-6f528f6bc3ca admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=82457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:38:45.850834 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: INFO nova.api.openstack.requestlog [None req-472a6fed-4b73-4f42-857b-6f528f6bc3ca admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.87 time: 0.113139 Apr 08 02:38:45.851371 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: [pid: 82457|app: 0|req: 26/53] 10.222.0.48 () {64 vars in 1235 bytes} [Fri Apr 8 02:38:45 2022] POST /compute/v2.1/flavors => generated 405 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 02:38:47.207796 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi [None req-f74373aa-f670-4dfe-ae0c-8462e19c4d7e admin admin] Calling method '>' {{(pid=82458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:38:47.208817 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: INFO nova.api.openstack.requestlog [None req-f74373aa-f670-4dfe-ae0c-8462e19c4d7e admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Apr 08 02:38:47.209210 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: [pid: 82458|app: 0|req: 28/54] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Apr 8 02:38:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:38:47.424594 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi [None req-10351a25-95d0-4ba1-a5c9-bb41752b6f4c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=82457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:38:47.457839 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: INFO nova.api.openstack.requestlog [None req-10351a25-95d0-4ba1-a5c9-bb41752b6f4c admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.87 time: 0.112810 Apr 08 02:38:47.458373 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: [pid: 82457|app: 0|req: 27/55] 10.222.0.48 () {64 vars in 1235 bytes} [Fri Apr 8 02:38:47 2022] POST /compute/v2.1/flavors => generated 407 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 08 02:38:48.820797 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi [None req-f74373aa-f670-4dfe-ae0c-8462e19c4d7e admin admin] Calling method '>' {{(pid=82458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:38:48.821820 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: INFO nova.api.openstack.requestlog [None req-f74373aa-f670-4dfe-ae0c-8462e19c4d7e admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Apr 08 02:38:48.822222 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: [pid: 82458|app: 0|req: 29/56] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Apr 8 02:38:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:38:49.039532 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi [None req-b8badace-4f5e-4866-8ff9-7f529603c5b5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=82457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:38:49.072221 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: INFO nova.api.openstack.requestlog [None req-b8badace-4f5e-4866-8ff9-7f529603c5b5 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.87 time: 0.113938 Apr 08 02:38:49.072683 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: [pid: 82457|app: 0|req: 28/57] 10.222.0.48 () {64 vars in 1235 bytes} [Fri Apr 8 02:38:48 2022] POST /compute/v2.1/flavors => generated 409 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 02:38:50.413607 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi [None req-f74373aa-f670-4dfe-ae0c-8462e19c4d7e admin admin] Calling method '>' {{(pid=82458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:38:50.414617 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: INFO nova.api.openstack.requestlog [None req-f74373aa-f670-4dfe-ae0c-8462e19c4d7e admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Apr 08 02:38:50.415051 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: [pid: 82458|app: 0|req: 30/58] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Apr 8 02:38:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:38:50.626495 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi [None req-49899d3f-6358-4182-8d4b-92dcffcdb618 admin admin] Calling method '>' {{(pid=82457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:38:50.656201 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: INFO nova.api.openstack.requestlog [None req-49899d3f-6358-4182-8d4b-92dcffcdb618 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.87 time: 0.108085 Apr 08 02:38:50.656724 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: [pid: 82457|app: 0|req: 29/59] 10.222.0.48 () {60 vars in 1202 bytes} [Fri Apr 8 02:38:50 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:39:28.473984 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi [None req-f74373aa-f670-4dfe-ae0c-8462e19c4d7e admin admin] Calling method '>' {{(pid=82458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:39:28.475007 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: INFO nova.api.openstack.requestlog [None req-f74373aa-f670-4dfe-ae0c-8462e19c4d7e admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001391 Apr 08 02:39:28.475398 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: [pid: 82458|app: 0|req: 31/60] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Apr 8 02:39:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:39:28.687314 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi [None req-e76a5990-b978-41df-981c-d8abb5bf76ad admin admin] Calling method '>' {{(pid=82457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:39:28.719416 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: INFO nova.api.openstack.requestlog [None req-e76a5990-b978-41df-981c-d8abb5bf76ad admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.87 time: 0.109931 Apr 08 02:39:28.719950 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: [pid: 82457|app: 0|req: 30/61] 10.222.0.48 () {60 vars in 1202 bytes} [Fri Apr 8 02:39:28 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:40:55.889091 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi [None req-6247c357-fc7e-404e-a7c6-7ab8d8146381 tempest-verify_tempest_config-500651806 tempest-verify_tempest_config-500651806-project] Calling method '>' {{(pid=82458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:40:55.895778 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: INFO nova.api.openstack.requestlog [None req-6247c357-fc7e-404e-a7c6-7ab8d8146381 tempest-verify_tempest_config-500651806 tempest-verify_tempest_config-500651806-project] 10.222.0.48 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.144077 Apr 08 02:40:55.896303 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: [pid: 82458|app: 0|req: 32/62] 10.222.0.48 () {58 vars in 1133 bytes} [Fri Apr 8 02:40:55 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 02:42:31.734814 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi [None req-e76a5990-b978-41df-981c-d8abb5bf76ad admin admin] Calling method '>' {{(pid=82457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:42:31.735799 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: INFO nova.api.openstack.requestlog [None req-e76a5990-b978-41df-981c-d8abb5bf76ad admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Apr 08 02:42:31.736188 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: [pid: 82457|app: 0|req: 31/63] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Apr 8 02:42:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:42:32.022524 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi [None req-bd8d428a-6bd6-4df4-9dd4-a47829bbd10a admin admin] Calling method '>' {{(pid=82458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:42:32.028487 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:42:32.028487 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: warnings.warn(msg) Apr 08 02:42:32.029959 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG oslo_concurrency.lockutils [None req-bd8d428a-6bd6-4df4-9dd4-a47829bbd10a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:42:32.030392 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG oslo_concurrency.lockutils [None req-bd8d428a-6bd6-4df4-9dd4-a47829bbd10a admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:42:32.031202 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG oslo_concurrency.lockutils [None req-bd8d428a-6bd6-4df4-9dd4-a47829bbd10a admin admin] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:42:32.031620 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG oslo_concurrency.lockutils [None req-bd8d428a-6bd6-4df4-9dd4-a47829bbd10a admin admin] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:42:32.063321 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: INFO nova.api.openstack.requestlog [None req-bd8d428a-6bd6-4df4-9dd4-a47829bbd10a admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.87 time: 0.187078 Apr 08 02:42:32.063875 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: [pid: 82458|app: 0|req: 33/64] 10.222.0.48 () {60 vars in 1193 bytes} [Fri Apr 8 02:42:31 2022] GET /compute/v2.1/os-services => generated 791 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 02:42:33.412942 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi [None req-e76a5990-b978-41df-981c-d8abb5bf76ad admin admin] Calling method '>' {{(pid=82457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:42:33.413932 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: INFO nova.api.openstack.requestlog [None req-e76a5990-b978-41df-981c-d8abb5bf76ad admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001389 Apr 08 02:42:33.414324 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: [pid: 82457|app: 0|req: 32/65] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Apr 8 02:42:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:42:33.634105 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi [None req-1e8ce13d-b54f-4836-b7c5-35bcdd9c8e86 admin admin] Calling method '>' {{(pid=82458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:42:33.640814 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:42:33.640814 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: warnings.warn(msg) Apr 08 02:42:33.642367 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG oslo_concurrency.lockutils [None req-1e8ce13d-b54f-4836-b7c5-35bcdd9c8e86 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:42:33.643090 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG oslo_concurrency.lockutils [None req-1e8ce13d-b54f-4836-b7c5-35bcdd9c8e86 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:42:33.643878 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG oslo_concurrency.lockutils [None req-1e8ce13d-b54f-4836-b7c5-35bcdd9c8e86 admin admin] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:42:33.644300 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG oslo_concurrency.lockutils [None req-1e8ce13d-b54f-4836-b7c5-35bcdd9c8e86 admin admin] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:42:33.669721 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: INFO nova.api.openstack.requestlog [None req-1e8ce13d-b54f-4836-b7c5-35bcdd9c8e86 admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.87 time: 0.118475 Apr 08 02:42:33.670371 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: [pid: 82458|app: 0|req: 34/66] 10.222.0.48 () {60 vars in 1193 bytes} [Fri Apr 8 02:42:33 2022] GET /compute/v2.1/os-services => generated 791 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 02:42:45.443077 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi [None req-e76a5990-b978-41df-981c-d8abb5bf76ad admin admin] Calling method '>' {{(pid=82457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:42:45.444065 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: INFO nova.api.openstack.requestlog [None req-e76a5990-b978-41df-981c-d8abb5bf76ad admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Apr 08 02:42:45.444448 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: [pid: 82457|app: 0|req: 33/67] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Apr 8 02:42:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:42:45.658950 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi [None req-87ad821c-c210-40be-a3bf-6015dc7f42cf admin admin] Calling method '>' {{(pid=82458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:42:45.664565 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:42:45.664565 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: warnings.warn(msg) Apr 08 02:42:45.665990 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG oslo_concurrency.lockutils [None req-87ad821c-c210-40be-a3bf-6015dc7f42cf admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:42:45.666418 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG oslo_concurrency.lockutils [None req-87ad821c-c210-40be-a3bf-6015dc7f42cf admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:42:45.667406 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG oslo_concurrency.lockutils [None req-87ad821c-c210-40be-a3bf-6015dc7f42cf admin admin] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:42:45.667823 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG oslo_concurrency.lockutils [None req-87ad821c-c210-40be-a3bf-6015dc7f42cf admin admin] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:42:45.695767 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: INFO nova.api.openstack.requestlog [None req-87ad821c-c210-40be-a3bf-6015dc7f42cf admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.87 time: 0.115408 Apr 08 02:42:45.696327 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: [pid: 82458|app: 0|req: 35/68] 10.222.0.48 () {60 vars in 1193 bytes} [Fri Apr 8 02:42:45 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:42:47.048873 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: DEBUG nova.api.openstack.wsgi [None req-e76a5990-b978-41df-981c-d8abb5bf76ad admin admin] Calling method '>' {{(pid=82457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:42:47.049863 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: INFO nova.api.openstack.requestlog [None req-e76a5990-b978-41df-981c-d8abb5bf76ad admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Apr 08 02:42:47.050253 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: [pid: 82457|app: 0|req: 34/69] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Apr 8 02:42:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:42:47.265396 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG nova.api.openstack.wsgi [None req-2e0e432e-d8c0-4291-bf50-1afb8c7c353f admin admin] Calling method '>' {{(pid=82458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:42:47.271438 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:42:47.271438 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: warnings.warn(msg) Apr 08 02:42:47.272875 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG oslo_concurrency.lockutils [None req-2e0e432e-d8c0-4291-bf50-1afb8c7c353f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:42:47.273309 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG oslo_concurrency.lockutils [None req-2e0e432e-d8c0-4291-bf50-1afb8c7c353f admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:42:47.274084 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG oslo_concurrency.lockutils [None req-2e0e432e-d8c0-4291-bf50-1afb8c7c353f admin admin] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=82458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:42:47.274504 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: DEBUG oslo_concurrency.lockutils [None req-2e0e432e-d8c0-4291-bf50-1afb8c7c353f admin admin] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=82458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:42:47.302889 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: INFO nova.api.openstack.requestlog [None req-2e0e432e-d8c0-4291-bf50-1afb8c7c353f admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.87 time: 0.116786 Apr 08 02:42:47.303455 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: [pid: 82458|app: 0|req: 36/70] 10.222.0.48 () {60 vars in 1193 bytes} [Fri Apr 8 02:42:47 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:43:42.536063 dv-cinder-837052-1-iscsi devstack@n-api.service[82456]: Fri Apr 8 02:43:42 2022 - graceful shutdown triggered... Apr 08 02:43:42.536588 dv-cinder-837052-1-iscsi devstack@n-api.service[82458]: Gracefully killing worker 2 (pid: 82458)... Apr 08 02:43:42.536189 dv-cinder-837052-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Apr 08 02:43:42.537373 dv-cinder-837052-1-iscsi devstack@n-api.service[82457]: Gracefully killing worker 1 (pid: 82457)... Apr 08 02:43:43.537188 dv-cinder-837052-1-iscsi devstack@n-api.service[82456]: worker 1 buried after 1 seconds Apr 08 02:43:43.537188 dv-cinder-837052-1-iscsi devstack@n-api.service[82456]: worker 2 buried after 1 seconds Apr 08 02:43:43.537188 dv-cinder-837052-1-iscsi devstack@n-api.service[82456]: goodbye to uWSGI. Apr 08 02:43:43.538723 dv-cinder-837052-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Apr 08 02:43:43.539297 dv-cinder-837052-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Apr 08 02:43:43.542624 dv-cinder-837052-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Apr 08 02:43:43.551970 dv-cinder-837052-1-iscsi devstack@n-api.service[96908]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 08 02:43:43.553981 dv-cinder-837052-1-iscsi devstack@n-api.service[96908]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Apr 8 02:43:43 2022] *** Apr 08 02:43:43.553981 dv-cinder-837052-1-iscsi devstack@n-api.service[96908]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Apr 08 02:43:43.553981 dv-cinder-837052-1-iscsi devstack@n-api.service[96908]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Apr 08 02:43:43.553981 dv-cinder-837052-1-iscsi devstack@n-api.service[96908]: nodename: dv-cinder-837052-1-iscsi Apr 08 02:43:43.553981 dv-cinder-837052-1-iscsi devstack@n-api.service[96908]: machine: x86_64 Apr 08 02:43:43.553981 dv-cinder-837052-1-iscsi devstack@n-api.service[96908]: clock source: unix Apr 08 02:43:43.553981 dv-cinder-837052-1-iscsi devstack@n-api.service[96908]: pcre jit disabled Apr 08 02:43:43.553981 dv-cinder-837052-1-iscsi devstack@n-api.service[96908]: detected number of CPU cores: 4 Apr 08 02:43:43.553981 dv-cinder-837052-1-iscsi devstack@n-api.service[96908]: current working directory: / Apr 08 02:43:43.553981 dv-cinder-837052-1-iscsi devstack@n-api.service[96908]: detected binary path: /usr/bin/uwsgi-core Apr 08 02:43:43.553981 dv-cinder-837052-1-iscsi devstack@n-api.service[96908]: your processes number limit is 47680 Apr 08 02:43:43.554856 dv-cinder-837052-1-iscsi devstack@n-api.service[96908]: your memory page size is 4096 bytes Apr 08 02:43:43.554856 dv-cinder-837052-1-iscsi devstack@n-api.service[96908]: detected max file descriptor number: 2048 Apr 08 02:43:43.554856 dv-cinder-837052-1-iscsi devstack@n-api.service[96908]: lock engine: pthread robust mutexes Apr 08 02:43:43.554856 dv-cinder-837052-1-iscsi devstack@n-api.service[96908]: thunder lock: enabled Apr 08 02:43:43.554856 dv-cinder-837052-1-iscsi devstack@n-api.service[96908]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 08 02:43:43.554856 dv-cinder-837052-1-iscsi devstack@n-api.service[96908]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Apr 08 02:43:43.594967 dv-cinder-837052-1-iscsi devstack@n-api.service[96908]: Python main interpreter initialized at 0x55a573d699c0 Apr 08 02:43:43.594967 dv-cinder-837052-1-iscsi devstack@n-api.service[96908]: python threads support enabled Apr 08 02:43:43.594967 dv-cinder-837052-1-iscsi devstack@n-api.service[96908]: your server socket listen backlog is limited to 100 connections Apr 08 02:43:43.594967 dv-cinder-837052-1-iscsi devstack@n-api.service[96908]: your mercy for graceful operations on workers is 90 seconds Apr 08 02:43:43.595390 dv-cinder-837052-1-iscsi devstack@n-api.service[96908]: mapped 403077 bytes (393 KB) for 2 cores Apr 08 02:43:43.595390 dv-cinder-837052-1-iscsi devstack@n-api.service[96908]: *** Operational MODE: preforking *** Apr 08 02:43:43.595639 dv-cinder-837052-1-iscsi devstack@n-api.service[96908]: *** uWSGI is running in multiple interpreter mode *** Apr 08 02:43:43.595639 dv-cinder-837052-1-iscsi devstack@n-api.service[96908]: spawned uWSGI master process (pid: 96908) Apr 08 02:43:43.595840 dv-cinder-837052-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Apr 08 02:43:43.599594 dv-cinder-837052-1-iscsi devstack@n-api.service[96908]: spawned uWSGI worker 1 (pid: 96919, cores: 1) Apr 08 02:43:43.599594 dv-cinder-837052-1-iscsi devstack@n-api.service[96908]: spawned uWSGI worker 2 (pid: 96920, cores: 1) Apr 08 02:43:43.599594 dv-cinder-837052-1-iscsi devstack@n-api.service[96908]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 08 02:43:47.691163 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 08 02:43:47.691801 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 08 02:43:47.691893 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 08 02:43:47.692248 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 08 02:43:47.692508 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 08 02:43:47.692898 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.693226 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.693552 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] bandwidth_poll_interval = 600 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.693888 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] bindir = /usr/local/bin {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.694210 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.694534 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.694892 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.695208 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.695318 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 08 02:43:47.695809 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 08 02:43:47.695896 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.696094 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 08 02:43:47.696240 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.696336 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.696414 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 08 02:43:47.696604 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.696703 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 08 02:43:47.696926 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.697043 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.697281 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837052-1-iscsi {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.697396 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.697594 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.697701 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] bandwidth_poll_interval = 600 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.697906 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.698072 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] bindir = /usr/local/bin {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.698227 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.698380 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.698536 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.698726 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.698879 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.699038 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.699189 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.699338 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.699488 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.699632 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.699792 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.699944 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.700394 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.700394 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.700752 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.700917 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.701095 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.701250 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837052-1-iscsi {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.701401 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.701566 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.701713 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.701868 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.702023 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.702176 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.702330 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.702483 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.702633 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.702841 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.702996 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.703141 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.703294 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.703437 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.703586 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.703586 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837052-1-iscsi {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.703957 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.704126 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.704277 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.704420 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.704608 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.704761 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.704911 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.704911 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.705189 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.705345 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.705490 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.705642 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.705793 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.705942 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.706347 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.706515 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.706744 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.706919 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.707078 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.707318 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.707547 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.707739 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837052-1-iscsi {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.707890 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.708043 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.708194 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.708378 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.708529 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.708688 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.708840 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.709004 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.709151 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.709300 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.709588 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.709752 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.709998 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.710171 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.710326 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.711682 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.711849 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.711994 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.712147 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.712147 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.712444 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.712607 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.712753 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.712896 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.713038 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.713191 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.713351 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.713507 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.713663 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.713663 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.713945 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.714098 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.714267 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.714413 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.714563 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.714770 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.716009 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.716215 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.716659 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.716823 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.716969 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.717121 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.717451 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.717707 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.717889 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.718068 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.718315 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.718470 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.718470 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.718806 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.718960 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.719116 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.719266 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.719421 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.719577 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.719732 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.719897 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.720043 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.720191 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.720345 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.720539 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.720690 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.720839 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.720984 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.721133 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.721288 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.721457 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.721612 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.721766 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.721927 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.722082 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.722232 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.722384 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.722528 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.722757 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.722921 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.723073 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.723224 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.723382 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.723535 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.723680 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.723830 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.723991 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.724135 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.724286 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.724437 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.724590 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.724745 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.724888 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.725043 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.725188 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.725338 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.725482 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.725625 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.725778 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.725936 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.726090 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.726242 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.726393 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.727383 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.727501 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.727624 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.727712 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.727799 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.727879 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.727952 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.728031 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.728112 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.728191 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.728264 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.728341 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.728418 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.728501 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.728579 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.728656 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.728734 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.728810 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.728882 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.728965 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.729045 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.729116 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.729186 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.729256 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.729326 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.729408 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.729490 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.729562 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.729632 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.729712 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.729712 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.729862 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.729942 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.730023 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.730101 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.730193 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.730271 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.730352 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.730433 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.730510 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.730588 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.730757 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.730859 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.730934 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.731011 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.731095 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.731175 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.731253 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.731325 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.731395 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.731464 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.731594 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.731675 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.731747 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.731816 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.731886 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.731964 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.732044 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.732122 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.732194 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.732272 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.732351 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.732432 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.732773 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.732876 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.732958 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.733043 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.733183 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.733328 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.733460 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.733567 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.733770 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.733872 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.734080 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.734182 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.734389 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.734483 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.734716 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.734812 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.735027 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.735121 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.735338 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.735513 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.735678 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.735825 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.735966 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.736106 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.736237 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.736378 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.736509 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.736655 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.736991 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.737123 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.737253 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.737417 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.737638 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.737910 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.738058 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.738200 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.738341 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.738487 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.738626 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.738797 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.738929 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.739068 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.739207 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.739356 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.739496 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.739627 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.739763 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:43:47.740010 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.740158 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.740290 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.740426 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.740576 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.740715 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.740860 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.741004 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.741135 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.741273 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.741411 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.741543 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.741682 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.741820 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.741951 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.742087 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.742224 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.742394 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.742705 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.743555 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.743734 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.743884 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.744037 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.744194 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.744355 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.744501 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.744845 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.745014 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.745178 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.745437 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.745669 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.745838 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.745991 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.746144 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.746296 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.746441 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.746585 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.746800 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.747154 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.747327 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.747482 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.747646 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.748144 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.748306 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.748460 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.748613 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.748765 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.748912 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.749065 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.749210 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.749354 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.749522 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.749691 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.749885 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.750061 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.750216 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.750360 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.750503 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.750728 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.750898 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.751129 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.751277 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.751467 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.751621 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.751776 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.751945 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.752099 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.752244 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.752388 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.752542 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.752696 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.752696 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.752987 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.753141 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.753389 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.753547 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.753740 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.753896 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.754068 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.754225 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.754376 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.754520 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.754757 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.754924 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.755125 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.755276 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.755440 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.755701 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.755856 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.756015 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.756171 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.756315 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.756459 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.756608 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.756761 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.756911 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.757264 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.757463 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.757636 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.757799 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.758763 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.758958 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.759177 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.759349 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.759518 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.759729 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.759932 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.760078 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.760230 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.760414 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.760560 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.760710 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.760864 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.761018 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.761163 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.761308 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.761308 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.761616 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.761616 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.761905 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.762049 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.762192 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.762335 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.762488 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.762633 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.762825 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.762984 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.763129 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.763314 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.763520 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.763695 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.763849 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.764032 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.764189 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.764342 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.764508 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.764696 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.764879 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.765031 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.765191 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.765336 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.765494 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.765681 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.765833 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.765984 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.766129 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.766286 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.766433 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.766583 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.766761 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.766909 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.767514 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.767680 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.767834 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.767978 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.768133 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.768289 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.768432 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.768740 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.768980 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.769142 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.769288 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.769288 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.769568 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.769726 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.769882 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.770034 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.770190 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.770342 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.770492 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.770492 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.770779 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.770910 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.771013 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.771103 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.771199 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.771295 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.771389 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.771483 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.771569 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.771653 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.771746 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.771832 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.771917 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.772000 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.772083 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.772167 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.772263 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.772357 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.772449 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.772534 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.772617 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.772708 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.772806 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.772891 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.772976 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.773067 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.773158 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.773252 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.773337 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.773428 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.773520 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.774203 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.774297 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.774396 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.774490 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.774581 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.774688 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.774776 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.774873 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.774968 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.775054 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.775145 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.775237 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.775329 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.775421 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.775514 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.775609 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.775694 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.775793 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.775894 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.775992 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.776086 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.776179 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.776264 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.776355 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.776439 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.776687 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.776806 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.777011 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.777121 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.777338 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.777431 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.777659 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.777762 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.777964 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.778063 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.778274 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.778364 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.778584 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.778696 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.778922 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.779070 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.779255 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.779360 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.779570 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.779664 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.779892 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.780073 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.780225 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.780383 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.780553 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.780708 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.780866 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.781020 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.781166 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.781445 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.781619 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.781779 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.781931 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.782083 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.782228 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.782381 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] glance.allowed_direct_url_schemes = [] {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.782526 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.782711 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.782864 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.783027 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.783177 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.783335 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.783481 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.783624 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.783777 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.783921 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.784071 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.784229 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.784375 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.784520 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.784662 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] glance.allowed_direct_url_schemes = [] {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.784813 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.784958 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.785113 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.785258 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.785409 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.785565 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.785709 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.785865 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.786064 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.786228 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.786380 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.786575 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.786762 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.786927 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.787081 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.787081 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.787357 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.787528 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.788013 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.788182 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.788328 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.788472 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.788629 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.788792 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.789080 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.789420 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.789580 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.789744 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.790010 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.790248 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.790408 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.790408 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.790742 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.790895 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.791039 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.791181 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.791342 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.791488 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.791488 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.791769 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.791921 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.792066 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.792219 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.792364 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.792524 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.792682 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.792827 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.792994 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.793159 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.793343 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.793527 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.793672 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.793823 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.793975 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.794133 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.794279 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.794431 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.794586 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.794923 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.795085 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.795230 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.795390 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.795535 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.795685 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.795836 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.795990 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.796143 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.796287 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.796430 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.796587 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.796750 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.796903 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.797055 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.797200 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.797350 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.797494 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.797644 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.797818 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.798179 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.798331 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.798475 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.798626 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.798813 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.798978 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.799279 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.799467 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.799695 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.799695 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.799993 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.800138 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.800314 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.800548 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.800695 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.800847 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.801005 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.801166 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.801319 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.801465 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.801616 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.801761 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.801914 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.802060 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.802203 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.802347 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.802491 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.802641 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.802842 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.803003 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.803171 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.803315 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.803460 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.803612 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.803765 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.803917 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.804068 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.804068 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.804353 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.804353 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.804662 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.804884 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.805138 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.805335 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.805490 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.805655 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.805815 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.805973 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.806137 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.806296 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.806455 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.806607 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.806796 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.806962 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.807133 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.807286 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.807455 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.807607 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.807758 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.807991 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.808354 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.808517 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.808669 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.808820 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.808985 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.809277 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.809447 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.809599 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.809857 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.810082 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.810242 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.810401 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.810554 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.810734 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.810894 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.811067 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.811220 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.811372 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.811522 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.811679 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.811832 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.812008 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.812167 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.812318 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.812476 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.812626 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.812784 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.812956 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.813121 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.813273 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.813424 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.813582 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.813782 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.813946 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.814126 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.814277 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.814436 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.814628 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.814858 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.815023 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.815176 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.815333 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.815492 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.815643 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.815807 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.815961 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.816112 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.816281 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.816439 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.816597 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.816760 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.816923 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.817079 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.817228 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.817379 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.817536 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.817696 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.817848 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.817998 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.818158 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.818533 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.818725 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.818884 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.819043 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.819195 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.819497 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.819647 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.819811 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.820064 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.820222 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.820884 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.821046 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.821198 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.821374 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.821527 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.821684 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.821843 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.822001 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.822159 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.822324 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.822484 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.822634 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.822808 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.822970 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.822970 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.823271 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.823447 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.823603 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.823753 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.823912 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.824079 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.824239 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.824473 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.824634 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.824634 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.824929 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.825094 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.825246 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.825419 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.825570 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.825737 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.825898 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.826064 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.826235 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.826387 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.826387 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.826740 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.826909 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.827071 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.827224 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.827374 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.827542 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.827701 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.827852 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.828015 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.828167 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.828316 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.828683 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.828845 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.829007 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.829166 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.829456 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.829626 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.829779 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.829947 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.830130 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.830368 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.830525 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.830694 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.830852 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.831013 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.831174 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.831334 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.831492 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.831651 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.831803 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.831965 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.832140 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.832292 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.832450 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.832741 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.832915 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.833070 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.833229 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.833387 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.833552 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.833704 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.833854 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.834017 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.834169 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.834338 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.834498 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.834650 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.834860 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.835021 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.835174 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.835325 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.835482 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.835634 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.835784 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.835944 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.836669 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.836839 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.837009 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.837197 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.837385 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.837546 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.837698 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.837698 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.838002 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.838162 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.838322 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.838475 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.838852 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.839014 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.839166 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.839339 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.839638 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.839803 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.839962 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.840115 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.840265 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.840522 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.840766 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.840929 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.841094 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.841254 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.841406 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.841579 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.841739 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.841892 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.842041 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.842191 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.842341 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.842341 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.842642 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.842854 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.843005 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.843155 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.843306 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.843477 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.843650 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.843810 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.843961 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.844118 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.844270 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.844430 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.844588 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.844588 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.844874 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.845024 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.845173 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.845334 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.845492 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.845654 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.845805 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.845963 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.846114 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.846273 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.846425 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.846583 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.846766 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.846922 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.847085 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.847244 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.847404 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.847563 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.847563 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.847563 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.848002 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.848154 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.848310 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.848470 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.848620 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.848980 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.849154 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.849154 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.849451 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.849737 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.849896 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.850066 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.850228 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.850378 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.850548 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.850813 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.850973 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.851139 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.851291 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.851442 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.851591 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.851852 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.852122 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.852343 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.852558 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.852861 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.853023 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.853187 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.853347 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.853507 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.853671 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.853822 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.853972 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_usb_tablet = True {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.854123 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.854282 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.854442 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.854610 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.854847 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.855009 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.855176 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.855336 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.855501 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.855662 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.855814 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.855965 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.856122 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.856288 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.856441 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.856591 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.856751 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_usb_tablet = True {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.856911 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.857062 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.857222 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.857380 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.857380 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.857708 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.857873 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.858026 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.858190 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.858343 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.858343 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.xen_hvmloader_path = /usr/lib/xen/boot/hvmloader {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.858636 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.858839 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.859190 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.859365 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.859525 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.859819 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.859819 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.860124 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.860288 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.860440 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.860590 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.860748 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.861007 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.861180 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.861348 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.861501 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.861650 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.861800 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.xen_hvmloader_path = /usr/lib/xen/boot/hvmloader {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.861951 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.862101 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.862261 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.862420 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.862572 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.862770 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.862944 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.862944 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.863262 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.863262 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.863574 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.863727 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.863959 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.864120 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.864280 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.864438 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.864590 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.864740 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.864904 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.865063 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.865214 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.865385 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.865537 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.865695 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.865856 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.866015 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.866168 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.866326 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.866484 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.866644 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.866832 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.866984 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.867134 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.867323 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.867495 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.867657 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.867810 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.867968 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.868119 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.868277 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.868430 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.868589 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.868741 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.868741 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.869034 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.869402 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.869574 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.869752 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.870055 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.870379 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.870542 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.870723 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.870880 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.871060 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.871309 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.871507 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.871666 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.871817 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.871982 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.872143 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.872143 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.872450 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.872609 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.872761 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.872922 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.873073 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.873233 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.873384 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.873384 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.873684 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.873843 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.874004 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.874166 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.874324 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.874475 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.874626 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.874855 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.875017 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.875169 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.875328 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.875480 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.875643 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.875802 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.875961 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.876120 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.876282 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.876440 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.876604 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.876764 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.876916 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.877066 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.877216 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.877372 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.877537 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.877689 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.877848 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.877998 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.877998 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.878310 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.878471 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.878623 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.878807 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.878961 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.879111 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.879481 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.879660 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.879821 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.879821 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.879821 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.880402 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.880562 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.880724 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.880875 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.881034 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.881185 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.881580 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.881749 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.881903 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.882054 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.882204 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.882363 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.882522 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.882736 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.883418 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.883661 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.883831 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.883831 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.884226 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.884405 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.884558 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.884721 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.884881 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.driver = filter_scheduler {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.885040 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.885206 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.885366 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.885524 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.885687 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.885846 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.885998 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.886162 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.886315 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.886466 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.886623 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.886809 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.periodic_task_interval = 60 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.886970 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.887135 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.887289 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.887446 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.887446 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.887745 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.888010 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.888192 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.888349 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.888501 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.driver = filter_scheduler {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.888652 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.888848 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.889024 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.889192 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.889344 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.889725 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.889895 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.890244 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.890416 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.890576 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.890780 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.890937 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.periodic_task_interval = 60 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.891087 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.891087 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.891393 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.891545 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.891807 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.892214 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.892372 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.892546 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.892698 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.892849 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.892998 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.893158 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.893316 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.893481 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.893634 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.893786 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.893952 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.894116 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.894281 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.894434 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.894597 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.894786 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.894947 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.895099 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.895264 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.895421 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.895579 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.895732 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.895891 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.896042 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.896273 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.896451 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.896604 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.896763 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.896914 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.897074 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.897234 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.897386 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.897543 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.897704 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.897856 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.898016 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.898176 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.898176 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.898475 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.899207 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.899382 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.899545 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.899914 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.900076 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.900377 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.900535 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.900697 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.900850 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.901004 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.901155 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.901315 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.901479 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.901639 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.901639 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.902037 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.902203 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.902203 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.902501 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.902700 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.902700 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.902998 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.903150 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.903312 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.903475 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.903639 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.903792 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.903951 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.903951 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.904244 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.904405 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.904565 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.904724 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.904875 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.905033 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.905193 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.905373 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.905551 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.905711 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.905864 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.906023 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.906176 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.906341 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.906341 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.906647 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.906837 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.906991 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.906991 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.907289 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.907448 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.907611 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.907770 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.907936 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.908103 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.908264 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.908424 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.908424 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.908721 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.908882 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.909044 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.909204 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.909357 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.909508 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.909682 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.910057 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.910443 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.910607 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.910785 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.910938 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.911090 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.911241 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.911408 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.911562 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.911562 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.911857 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.912027 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.912293 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.912462 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.912624 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.912778 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.912929 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.913088 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.913249 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.913401 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.913553 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.913712 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.913880 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.914038 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.914244 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.914408 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.914569 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.914788 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.914948 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.915108 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.915273 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.915433 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.915599 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.915752 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.915910 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.916070 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.916238 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.916402 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.916553 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.916713 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.916872 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.917032 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.917184 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.917334 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.917492 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.917651 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.917804 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.917969 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.918129 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.918281 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.918442 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.918442 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.918760 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.918933 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.919087 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.919238 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.919238 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.919525 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.919676 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.919840 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.920216 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.920375 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.920696 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.920878 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.921038 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.921210 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.921371 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.921530 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.921682 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.921841 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.922003 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.922156 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.922332 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.922580 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.922580 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.922580 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.923148 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.923304 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.923462 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.923616 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.923767 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.923928 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.923928 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.924234 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.924385 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.924535 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.924693 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.924845 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.925023 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.925023 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.925321 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.925471 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.925623 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.925782 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.925934 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.926087 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.926237 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.926395 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.926556 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.926739 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.926907 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.927070 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.927221 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.927372 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.927522 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.927686 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.927837 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.927996 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.928148 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.928148 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.928451 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.928611 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.928764 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.928922 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.929088 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.929250 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.929411 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.929570 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.929730 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.930371 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.930546 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.930885 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.931124 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.931279 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.931434 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.931586 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.931751 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.931911 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.932080 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.932233 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.932386 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.932570 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.932931 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.933110 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.933271 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.933271 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.933570 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.933723 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.933881 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.934062 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.934217 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.934369 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.934522 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.934693 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.934852 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.935021 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.935175 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.935326 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.935484 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.935648 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.935810 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.935977 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.936128 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.936286 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.936286 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.936576 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.936737 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.936897 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.937049 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.937209 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.937362 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.937520 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.937683 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.937835 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.938007 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.938160 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.938312 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.938464 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.938732 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.938993 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.939175 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.939338 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.939491 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.939652 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.939805 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.939957 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.940118 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.940508 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.940685 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.946769 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.947005 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.947186 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.947349 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.947514 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.947671 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.947842 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.948005 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.948161 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.948322 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.948489 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.948642 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.948808 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.948968 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.949121 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.949273 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.949273 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.949584 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.949751 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.949904 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.950055 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.950055 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.950376 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.950578 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.950768 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.950935 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.951119 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.951283 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.951436 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.951597 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.951758 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.951918 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.952070 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.952222 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.952384 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.952548 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.952708 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.952860 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.953011 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.953169 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.953336 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.953490 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.953642 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.953801 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=96919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 08 02:43:47.953963 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.953963 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.953963 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.953963 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.953963 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.953963 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.953963 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.953963 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.955166 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.955166 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.955166 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.955166 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.955166 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.955166 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.955166 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.955166 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.956496 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.956496 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.956496 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.956496 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:43:47.956496 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=96920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 08 02:43:47.975754 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_db.sqlalchemy.engines [None req-42e4eaf2-151e-4e1f-b45b-f217b529b90a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=96919) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 08 02:43:47.990486 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_db.sqlalchemy.engines [None req-da631740-1970-4b95-87e6-c140d6072b7f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=96920) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 08 02:43:48.223778 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.context [None req-42e4eaf2-151e-4e1f-b45b-f217b529b90a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6d23fd24-1ab4-4f74-87ff-4e24114caf2e(cell1) {{(pid=96919) load_cells /opt/stack/nova/nova/context.py:465}} Apr 08 02:43:48.228036 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-42e4eaf2-151e-4e1f-b45b-f217b529b90a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:43:48.229699 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-42e4eaf2-151e-4e1f-b45b-f217b529b90a None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:43:48.230520 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-42e4eaf2-151e-4e1f-b45b-f217b529b90a None None] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:43:48.232528 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-42e4eaf2-151e-4e1f-b45b-f217b529b90a None None] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:43:48.236801 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.context [None req-da631740-1970-4b95-87e6-c140d6072b7f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6d23fd24-1ab4-4f74-87ff-4e24114caf2e(cell1) {{(pid=96920) load_cells /opt/stack/nova/nova/context.py:465}} Apr 08 02:43:48.241134 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-da631740-1970-4b95-87e6-c140d6072b7f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:43:48.243523 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-da631740-1970-4b95-87e6-c140d6072b7f None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:43:48.244626 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-da631740-1970-4b95-87e6-c140d6072b7f None None] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:43:48.246683 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-da631740-1970-4b95-87e6-c140d6072b7f None None] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:43:48.260785 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_db.sqlalchemy.engines [None req-42e4eaf2-151e-4e1f-b45b-f217b529b90a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=96919) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 08 02:43:48.261649 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_db.sqlalchemy.engines [None req-42e4eaf2-151e-4e1f-b45b-f217b529b90a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=96919) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 08 02:43:48.275440 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_db.sqlalchemy.engines [None req-da631740-1970-4b95-87e6-c140d6072b7f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=96920) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 08 02:43:48.276293 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_db.sqlalchemy.engines [None req-da631740-1970-4b95-87e6-c140d6072b7f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=96920) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 08 02:43:48.292178 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_db.sqlalchemy.engines [None req-42e4eaf2-151e-4e1f-b45b-f217b529b90a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=96919) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 08 02:43:48.304695 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_db.sqlalchemy.engines [None req-da631740-1970-4b95-87e6-c140d6072b7f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=96920) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 08 02:43:48.533092 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO keyring.backend [None req-42e4eaf2-151e-4e1f-b45b-f217b529b90a None None] Loading KWallet Apr 08 02:43:48.543276 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO keyring.backend [None req-42e4eaf2-151e-4e1f-b45b-f217b529b90a None None] Loading SecretService Apr 08 02:43:48.547252 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO keyring.backend [None req-42e4eaf2-151e-4e1f-b45b-f217b529b90a None None] Loading Windows Apr 08 02:43:48.548783 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO keyring.backend [None req-da631740-1970-4b95-87e6-c140d6072b7f None None] Loading KWallet Apr 08 02:43:48.549140 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO keyring.backend [None req-42e4eaf2-151e-4e1f-b45b-f217b529b90a None None] Loading chainer Apr 08 02:43:48.549961 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO keyring.backend [None req-42e4eaf2-151e-4e1f-b45b-f217b529b90a None None] Loading macOS Apr 08 02:43:48.558779 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO keyring.backend [None req-da631740-1970-4b95-87e6-c140d6072b7f None None] Loading SecretService Apr 08 02:43:48.562764 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO keyring.backend [None req-da631740-1970-4b95-87e6-c140d6072b7f None None] Loading Windows Apr 08 02:43:48.564674 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO keyring.backend [None req-da631740-1970-4b95-87e6-c140d6072b7f None None] Loading chainer Apr 08 02:43:48.565494 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO keyring.backend [None req-da631740-1970-4b95-87e6-c140d6072b7f None None] Loading macOS Apr 08 02:43:48.802277 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: WARNING keystonemiddleware.auth_token [None req-42e4eaf2-151e-4e1f-b45b-f217b529b90a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 08 02:43:48.809725 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: WARNING keystonemiddleware.auth_token [None req-42e4eaf2-151e-4e1f-b45b-f217b529b90a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 08 02:43:48.818338 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: WARNING keystonemiddleware.auth_token [None req-da631740-1970-4b95-87e6-c140d6072b7f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 08 02:43:48.825508 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: WARNING keystonemiddleware.auth_token [None req-da631740-1970-4b95-87e6-c140d6072b7f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 08 02:43:49.025724 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: WARNING keystonemiddleware.auth_token [None req-42e4eaf2-151e-4e1f-b45b-f217b529b90a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 08 02:43:49.030922 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: WARNING keystonemiddleware.auth_token [None req-42e4eaf2-151e-4e1f-b45b-f217b529b90a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 08 02:43:49.036161 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a573d699c0 pid: 96919 (default app) Apr 08 02:43:49.041654 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: WARNING keystonemiddleware.auth_token [None req-da631740-1970-4b95-87e6-c140d6072b7f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 08 02:43:49.046903 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: WARNING keystonemiddleware.auth_token [None req-da631740-1970-4b95-87e6-c140d6072b7f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 08 02:43:49.052094 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a573d699c0 pid: 96920 (default app) Apr 08 02:44:33.200775 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-fe8a422c-3c6f-48f1-abaf-4ef56893f734 tempest-VolumesSnapshotsTestJSON-56616674 tempest-VolumesSnapshotsTestJSON-56616674-project] Action: 'create', calling method: .version_select at 0x7f7d4e828d30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1097986920"}} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:44:33.495236 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-e06cc07a-2b67-40fd-97f6-5ab402bfae37 tempest-VolumesNegativeTest-993478448 tempest-VolumesNegativeTest-993478448-project] Action: 'create', calling method: .version_select at 0x7f7d4e826d30>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-854304174", "metadata": {"Type": "work"}}} {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:44:33.496941 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-e06cc07a-2b67-40fd-97f6-5ab402bfae37 tempest-VolumesNegativeTest-993478448 tempest-VolumesNegativeTest-993478448-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=96920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Apr 08 02:44:33.497768 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-e06cc07a-2b67-40fd-97f6-5ab402bfae37 tempest-VolumesNegativeTest-993478448 tempest-VolumesNegativeTest-993478448-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.356287 Apr 08 02:44:33.498318 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 1/1] 10.222.0.48 () {60 vars in 1155 bytes} [Fri Apr 8 02:44:32 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1360 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 08 02:44:33.516263 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-1a75dbdb-defc-46f2-a4ae-1b32f4efe68f tempest-VolumesNegativeTest-993478448 tempest-VolumesNegativeTest-993478448-project] Action: 'create', calling method: .version_select at 0x7f7d4e700700>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2114984701", "metadata": {"Type": "work"}}} {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:44:33.518123 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-1a75dbdb-defc-46f2-a4ae-1b32f4efe68f tempest-VolumesNegativeTest-993478448 tempest-VolumesNegativeTest-993478448-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=96920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Apr 08 02:44:33.523532 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-1a75dbdb-defc-46f2-a4ae-1b32f4efe68f tempest-VolumesNegativeTest-993478448 tempest-VolumesNegativeTest-993478448-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.018935 Apr 08 02:44:33.524694 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 2/2] 10.222.0.48 () {60 vars in 1155 bytes} [Fri Apr 8 02:44:33 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 08 02:44:33.541165 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-1fcac2fc-58b6-49c1-aac8-9d311c1e643d tempest-VolumesNegativeTest-993478448 tempest-VolumesNegativeTest-993478448-project] Action: 'create', calling method: .version_select at 0x7f7d4ec4a940>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-772474001", "metadata": {"Type": "work"}}} {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:44:33.542590 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-1fcac2fc-58b6-49c1-aac8-9d311c1e643d tempest-VolumesNegativeTest-993478448 tempest-VolumesNegativeTest-993478448-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=96920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Apr 08 02:44:33.543824 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-1fcac2fc-58b6-49c1-aac8-9d311c1e643d tempest-VolumesNegativeTest-993478448 tempest-VolumesNegativeTest-993478448-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.014350 Apr 08 02:44:33.544806 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 3/3] 10.222.0.48 () {60 vars in 1155 bytes} [Fri Apr 8 02:44:33 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 08 02:44:33.566412 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-32a17ab9-1c69-4063-8617-684dbf3432ef tempest-VolumesNegativeTest-993478448 tempest-VolumesNegativeTest-993478448-project] Calling method '.version_select at 0x7f7d4e77e1f0>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:34.189147 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.wsgi [None req-32a17ab9-1c69-4063-8617-684dbf3432ef tempest-VolumesNegativeTest-993478448 tempest-VolumesNegativeTest-993478448-project] HTTP exception thrown: Volume tempest-invalid-1278238038 could not be found. Apr 08 02:44:34.189955 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-32a17ab9-1c69-4063-8617-684dbf3432ef tempest-VolumesNegativeTest-993478448 tempest-VolumesNegativeTest-993478448-project] Returning 404 to user: Volume tempest-invalid-1278238038 could not be found. {{(pid=96920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Apr 08 02:44:34.191048 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-32a17ab9-1c69-4063-8617-684dbf3432ef tempest-VolumesNegativeTest-993478448 tempest-VolumesNegativeTest-993478448-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1278238038" status: 404 len: 99 microversion: 2.1 time: 0.640539 Apr 08 02:44:34.191684 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 4/4] 10.222.0.48 () {58 vars in 1217 bytes} [Fri Apr 8 02:44:33 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1278238038 => generated 99 bytes in 643 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 08 02:44:34.367159 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-3cd0fac5-a7a3-46de-b2c0-030d86ef83ae tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1722157756", "imageRef": "7f8ca061-f382-4052-8d05-69f37e107684", "flavorRef": "452", "networks": [{"uuid": "5c913a7e-6767-4ead-ae16-5b243f13621e"}]}} {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:44:34.486824 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-fe8a422c-3c6f-48f1-abaf-4ef56893f734 tempest-VolumesSnapshotsTestJSON-56616674 tempest-VolumesSnapshotsTestJSON-56616674-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.022099 Apr 08 02:44:34.488038 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 1/5] 10.222.0.48 () {60 vars in 1154 bytes} [Fri Apr 8 02:44:31 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3025 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Apr 08 02:44:34.499386 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-9f454b18-ee3a-4e89-995c-f34db0bbdfc2 tempest-VolumesNegativeTest-993478448 tempest-VolumesNegativeTest-993478448-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.009810 Apr 08 02:44:34.500616 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 2/6] 10.222.0.48 () {58 vars in 1139 bytes} [Fri Apr 8 02:44:34 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 08 02:44:34.513245 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-4e4f3554-b8ab-408d-9286-7f07e8d91364 tempest-VolumesSnapshotsTestJSON-56616674 tempest-VolumesSnapshotsTestJSON-56616674-project] Calling method '.version_select at 0x7f7d4e66ef70>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:34.626813 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-4e4f3554-b8ab-408d-9286-7f07e8d91364 tempest-VolumesSnapshotsTestJSON-56616674 tempest-VolumesSnapshotsTestJSON-56616674-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/145dc661-0c3f-4f93-944a-3dbed75b35e6" status: 200 len: 345 microversion: 2.1 time: 0.125283 Apr 08 02:44:34.632790 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 3/7] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Apr 8 02:44:34 2022] GET /compute/v2.1/os-volumes/145dc661-0c3f-4f93-944a-3dbed75b35e6 => generated 345 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:44:34.632940 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.network.neutron [None req-3cd0fac5-a7a3-46de-b2c0-030d86ef83ae tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] validate_networks() for [('5c913a7e-6767-4ead-ae16-5b243f13621e', None, None, None)] {{(pid=96920) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} Apr 08 02:44:34.656775 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-5881025c-7427-4c4e-b465-063e570a64bd tempest-VolumesNegativeTest-993478448 tempest-VolumesNegativeTest-993478448-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.025144 Apr 08 02:44:34.661168 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 4/8] 10.222.0.48 () {58 vars in 1136 bytes} [Fri Apr 8 02:44:34 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 08 02:44:34.674123 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-da1833a2-b475-442d-8dcd-b66126df5bf9 tempest-VolumesNegativeTest-993478448 tempest-VolumesNegativeTest-993478448-project] Calling method '.version_select at 0x7f7d4e684670>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:34.755437 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.wsgi [None req-da1833a2-b475-442d-8dcd-b66126df5bf9 tempest-VolumesNegativeTest-993478448 tempest-VolumesNegativeTest-993478448-project] HTTP exception thrown: Volume a0ce2fa6-2200-488e-8f07-dc5dcb56b277 could not be found. Apr 08 02:44:34.756849 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-da1833a2-b475-442d-8dcd-b66126df5bf9 tempest-VolumesNegativeTest-993478448 tempest-VolumesNegativeTest-993478448-project] Returning 404 to user: Volume a0ce2fa6-2200-488e-8f07-dc5dcb56b277 could not be found. {{(pid=96919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Apr 08 02:44:34.757839 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-da1833a2-b475-442d-8dcd-b66126df5bf9 tempest-VolumesNegativeTest-993478448 tempest-VolumesNegativeTest-993478448-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/a0ce2fa6-2200-488e-8f07-dc5dcb56b277" status: 404 len: 109 microversion: 2.1 time: 0.092635 Apr 08 02:44:34.758836 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 5/9] 10.222.0.48 () {58 vars in 1247 bytes} [Fri Apr 8 02:44:34 2022] DELETE /compute/v2.1/os-volumes/a0ce2fa6-2200-488e-8f07-dc5dcb56b277 => generated 109 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 02:44:34.774649 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-c184a246-b212-4518-b8ef-708406b16a90 tempest-VolumesNegativeTest-993478448 tempest-VolumesNegativeTest-993478448-project] Calling method '.version_select at 0x7f7d4e6844c0>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:34.905527 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.wsgi [None req-c184a246-b212-4518-b8ef-708406b16a90 tempest-VolumesNegativeTest-993478448 tempest-VolumesNegativeTest-993478448-project] HTTP exception thrown: Volume b4bfb753-c2e7-4759-a82d-d359317cf03e could not be found. Apr 08 02:44:34.906133 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-c184a246-b212-4518-b8ef-708406b16a90 tempest-VolumesNegativeTest-993478448 tempest-VolumesNegativeTest-993478448-project] Returning 404 to user: Volume b4bfb753-c2e7-4759-a82d-d359317cf03e could not be found. {{(pid=96919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Apr 08 02:44:34.907045 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-c184a246-b212-4518-b8ef-708406b16a90 tempest-VolumesNegativeTest-993478448 tempest-VolumesNegativeTest-993478448-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/b4bfb753-c2e7-4759-a82d-d359317cf03e" status: 404 len: 109 microversion: 2.1 time: 0.142343 Apr 08 02:44:34.907949 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 6/10] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Apr 8 02:44:34 2022] GET /compute/v2.1/os-volumes/b4bfb753-c2e7-4759-a82d-d359317cf03e => generated 109 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 02:44:35.654931 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-7a8311e4-0da0-4385-849b-946352d857a3 tempest-VolumesSnapshotsTestJSON-56616674 tempest-VolumesSnapshotsTestJSON-56616674-project] Calling method '.version_select at 0x7f7d4ec4aaf0>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:35.860349 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-7a8311e4-0da0-4385-849b-946352d857a3 tempest-VolumesSnapshotsTestJSON-56616674 tempest-VolumesSnapshotsTestJSON-56616674-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/145dc661-0c3f-4f93-944a-3dbed75b35e6" status: 200 len: 345 microversion: 2.1 time: 0.221895 Apr 08 02:44:35.861298 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 7/11] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Apr 8 02:44:35 2022] GET /compute/v2.1/os-volumes/145dc661-0c3f-4f93-944a-3dbed75b35e6 => generated 345 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 02:44:36.781585 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.virt.hardware [None req-3cd0fac5-a7a3-46de-b2c0-030d86ef83ae tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Flavor limits 0:0:0 {{(pid=96920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} Apr 08 02:44:36.782068 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.virt.hardware [None req-3cd0fac5-a7a3-46de-b2c0-030d86ef83ae tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Image limits 0:0:0 {{(pid=96920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} Apr 08 02:44:36.782471 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.virt.hardware [None req-3cd0fac5-a7a3-46de-b2c0-030d86ef83ae tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Flavor pref 0:0:0 {{(pid=96920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} Apr 08 02:44:36.782902 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.virt.hardware [None req-3cd0fac5-a7a3-46de-b2c0-030d86ef83ae tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Image pref 0:0:0 {{(pid=96920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} Apr 08 02:44:36.783311 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.virt.hardware [None req-3cd0fac5-a7a3-46de-b2c0-030d86ef83ae tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=96920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} Apr 08 02:44:36.809114 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-3cd0fac5-a7a3-46de-b2c0-030d86ef83ae tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:36.809557 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-3cd0fac5-a7a3-46de-b2c0-030d86ef83ae tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:36.810357 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-3cd0fac5-a7a3-46de-b2c0-030d86ef83ae tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:36.810815 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-3cd0fac5-a7a3-46de-b2c0-030d86ef83ae tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:36.848673 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.quota [None req-3cd0fac5-a7a3-46de-b2c0-030d86ef83ae tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Getting quotas for project 08ab2bde6dca4830a67ca00d0223b3a7. Resources: {'instances', 'cores', 'ram'} {{(pid=96920) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:44:36.856803 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.quota [None req-3cd0fac5-a7a3-46de-b2c0-030d86ef83ae tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Getting quotas for user 2246bad06441497e9fd542cc1c84da0a and project 08ab2bde6dca4830a67ca00d0223b3a7. Resources: {'instances', 'cores', 'ram'} {{(pid=96920) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:44:36.887519 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-2233c9fb-dc96-4666-a3ce-3c99d69d17ee tempest-VolumesSnapshotsTestJSON-56616674 tempest-VolumesSnapshotsTestJSON-56616674-project] Calling method '.version_select at 0x7f7d4e684c10>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:36.904523 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-3cd0fac5-a7a3-46de-b2c0-030d86ef83ae tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Going to run 1 instances... {{(pid=96920) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} Apr 08 02:44:36.914998 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-3cd0fac5-a7a3-46de-b2c0-030d86ef83ae tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] [instance: 2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7f8ca061-f382-4052-8d05-69f37e107684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=96920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} Apr 08 02:44:37.074524 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-3cd0fac5-a7a3-46de-b2c0-030d86ef83ae tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.881435 Apr 08 02:44:37.078789 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 5/12] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Apr 8 02:44:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 2885 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 08 02:44:37.096017 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-2233c9fb-dc96-4666-a3ce-3c99d69d17ee tempest-VolumesSnapshotsTestJSON-56616674 tempest-VolumesSnapshotsTestJSON-56616674-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/145dc661-0c3f-4f93-944a-3dbed75b35e6" status: 200 len: 346 microversion: 2.1 time: 0.226388 Apr 08 02:44:37.096784 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 8/13] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Apr 8 02:44:36 2022] GET /compute/v2.1/os-volumes/145dc661-0c3f-4f93-944a-3dbed75b35e6 => generated 346 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 02:44:37.098829 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-8c7b930f-69df-402a-bd30-2fbc05e2c15e tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:37.100482 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-8c7b930f-69df-402a-bd30-2fbc05e2c15e tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] [instance: 2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:44:37.117252 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-4064aa76-db58-4a11-a1f3-f44a6d4404b6 tempest-VolumesSnapshotsTestJSON-56616674 tempest-VolumesSnapshotsTestJSON-56616674-project] Action: 'create', calling method: .version_select at 0x7f7d4e6849d0>, body: {"snapshot": {"volume_id": "145dc661-0c3f-4f93-944a-3dbed75b35e6", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-66620119"}} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:44:37.222306 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-8c7b930f-69df-402a-bd30-2fbc05e2c15e tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246bad06441497e9fd542cc1c84da0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ab2bde6dca4830a67ca00d0223b3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:44:37.238642 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-8c7b930f-69df-402a-bd30-2fbc05e2c15e tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] 10.222.0.48 "GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9" status: 200 len: 1215 microversion: 2.1 time: 0.156953 Apr 08 02:44:37.239658 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 6/14] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:44:37 2022] GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9 => generated 1215 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:44:37.678881 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-4064aa76-db58-4a11-a1f3-f44a6d4404b6 tempest-VolumesSnapshotsTestJSON-56616674 tempest-VolumesSnapshotsTestJSON-56616674-project] 10.222.0.48 "POST /compute/v2.1/os-snapshots" status: 200 len: 285 microversion: 2.1 time: 0.574589 Apr 08 02:44:37.684473 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 9/15] 10.222.0.48 () {60 vars in 1161 bytes} [Fri Apr 8 02:44:37 2022] POST /compute/v2.1/os-snapshots => generated 285 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:44:37.716691 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-dee1d480-f75f-43a8-8dda-734293611f84 tempest-VolumesSnapshotsTestJSON-56616674 tempest-VolumesSnapshotsTestJSON-56616674-project] Calling method '.version_select at 0x7f7d4e5dddc0>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:37.875855 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-dee1d480-f75f-43a8-8dda-734293611f84 tempest-VolumesSnapshotsTestJSON-56616674 tempest-VolumesSnapshotsTestJSON-56616674-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/3ed97e3a-8917-41e9-88cb-b58641c59153" status: 200 len: 285 microversion: 2.1 time: 0.189976 Apr 08 02:44:37.878281 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 7/16] 10.222.0.48 () {58 vars in 1250 bytes} [Fri Apr 8 02:44:37 2022] GET /compute/v2.1/os-snapshots/3ed97e3a-8917-41e9-88cb-b58641c59153 => generated 285 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 02:44:37.896109 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-07416f3a-28b0-4ba9-959d-7a27cd375cdf tempest-VolumesSnapshotsTestJSON-56616674 tempest-VolumesSnapshotsTestJSON-56616674-project] Calling method '.version_select at 0x7f7d4e690790>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:37.994353 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-07416f3a-28b0-4ba9-959d-7a27cd375cdf tempest-VolumesSnapshotsTestJSON-56616674 tempest-VolumesSnapshotsTestJSON-56616674-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots" status: 200 len: 288 microversion: 2.1 time: 0.110554 Apr 08 02:44:37.996062 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 10/17] 10.222.0.48 () {58 vars in 1139 bytes} [Fri Apr 8 02:44:37 2022] GET /compute/v2.1/os-snapshots => generated 288 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 02:44:38.017849 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-ba848e4d-2634-4b0f-ba95-9f72fd3bac87 tempest-VolumesSnapshotsTestJSON-56616674 tempest-VolumesSnapshotsTestJSON-56616674-project] Calling method '.version_select at 0x7f7d4e571f70>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:38.102247 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-ba848e4d-2634-4b0f-ba95-9f72fd3bac87 tempest-VolumesSnapshotsTestJSON-56616674 tempest-VolumesSnapshotsTestJSON-56616674-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/3ed97e3a-8917-41e9-88cb-b58641c59153" status: 200 len: 285 microversion: 2.1 time: 0.099397 Apr 08 02:44:38.103451 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 8/18] 10.222.0.48 () {58 vars in 1250 bytes} [Fri Apr 8 02:44:38 2022] GET /compute/v2.1/os-snapshots/3ed97e3a-8917-41e9-88cb-b58641c59153 => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:44:38.265571 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-6e1c32c9-45cd-4d4a-b0cf-b47dae514611 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:38.270406 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-6e1c32c9-45cd-4d4a-b0cf-b47dae514611 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] [instance: 2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:44:38.815224 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-6e1c32c9-45cd-4d4a-b0cf-b47dae514611 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246bad06441497e9fd542cc1c84da0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ab2bde6dca4830a67ca00d0223b3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:44:38.855587 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-6e1c32c9-45cd-4d4a-b0cf-b47dae514611 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] 10.222.0.48 "GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9" status: 200 len: 1215 microversion: 2.1 time: 0.602155 Apr 08 02:44:38.866739 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 11/19] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:44:38 2022] GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9 => generated 1215 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:44:39.123185 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-89c666b6-338e-4d45-ac30-0d7a6cc37b86 tempest-VolumesSnapshotsTestJSON-56616674 tempest-VolumesSnapshotsTestJSON-56616674-project] Calling method '.version_select at 0x7f7d4e583670>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:39.277204 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-89c666b6-338e-4d45-ac30-0d7a6cc37b86 tempest-VolumesSnapshotsTestJSON-56616674 tempest-VolumesSnapshotsTestJSON-56616674-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/3ed97e3a-8917-41e9-88cb-b58641c59153" status: 200 len: 285 microversion: 2.1 time: 0.167567 Apr 08 02:44:39.278544 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 9/20] 10.222.0.48 () {58 vars in 1250 bytes} [Fri Apr 8 02:44:39 2022] GET /compute/v2.1/os-snapshots/3ed97e3a-8917-41e9-88cb-b58641c59153 => generated 285 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 02:44:39.879636 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-34e5aa7d-6191-4691-a836-1b1c9d9b4904 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:39.883581 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-34e5aa7d-6191-4691-a836-1b1c9d9b4904 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] [instance: 2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:44:39.904860 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-34e5aa7d-6191-4691-a836-1b1c9d9b4904 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:39.906726 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-34e5aa7d-6191-4691-a836-1b1c9d9b4904 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:39.907918 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-34e5aa7d-6191-4691-a836-1b1c9d9b4904 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:39.909686 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-34e5aa7d-6191-4691-a836-1b1c9d9b4904 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:40.215350 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-34e5aa7d-6191-4691-a836-1b1c9d9b4904 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246bad06441497e9fd542cc1c84da0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ab2bde6dca4830a67ca00d0223b3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:44:40.239799 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-34e5aa7d-6191-4691-a836-1b1c9d9b4904 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] 10.222.0.48 "GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9" status: 200 len: 1219 microversion: 2.1 time: 0.369515 Apr 08 02:44:40.240910 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 12/21] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:44:39 2022] GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9 => generated 1219 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:44:40.307263 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-76269ad7-ec3f-4297-953b-968dfcd42ce2 tempest-VolumesSnapshotsTestJSON-56616674 tempest-VolumesSnapshotsTestJSON-56616674-project] Calling method '.version_select at 0x7f7d4e571ee0>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:40.459290 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-76269ad7-ec3f-4297-953b-968dfcd42ce2 tempest-VolumesSnapshotsTestJSON-56616674 tempest-VolumesSnapshotsTestJSON-56616674-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/3ed97e3a-8917-41e9-88cb-b58641c59153" status: 200 len: 285 microversion: 2.1 time: 0.173601 Apr 08 02:44:40.460059 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 10/22] 10.222.0.48 () {58 vars in 1250 bytes} [Fri Apr 8 02:44:40 2022] GET /compute/v2.1/os-snapshots/3ed97e3a-8917-41e9-88cb-b58641c59153 => generated 285 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:44:41.267076 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-b7c9807d-5e4f-4489-8248-b672c3aee706 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:41.267713 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-b7c9807d-5e4f-4489-8248-b672c3aee706 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] [instance: 2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:44:41.286321 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b7c9807d-5e4f-4489-8248-b672c3aee706 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:41.299418 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b7c9807d-5e4f-4489-8248-b672c3aee706 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:41.300483 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b7c9807d-5e4f-4489-8248-b672c3aee706 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:41.301266 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b7c9807d-5e4f-4489-8248-b672c3aee706 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:41.483898 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-15acaa56-911c-4707-90bb-05276226fc96 tempest-VolumesSnapshotsTestJSON-56616674 tempest-VolumesSnapshotsTestJSON-56616674-project] Calling method '.version_select at 0x7f7d4e5ddee0>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:41.585113 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-15acaa56-911c-4707-90bb-05276226fc96 tempest-VolumesSnapshotsTestJSON-56616674 tempest-VolumesSnapshotsTestJSON-56616674-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/3ed97e3a-8917-41e9-88cb-b58641c59153" status: 200 len: 285 microversion: 2.1 time: 0.116332 Apr 08 02:44:41.586157 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 11/23] 10.222.0.48 () {58 vars in 1250 bytes} [Fri Apr 8 02:44:41 2022] GET /compute/v2.1/os-snapshots/3ed97e3a-8917-41e9-88cb-b58641c59153 => generated 285 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 02:44:41.689543 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-b7c9807d-5e4f-4489-8248-b672c3aee706 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246bad06441497e9fd542cc1c84da0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ab2bde6dca4830a67ca00d0223b3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:44:41.725960 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-b7c9807d-5e4f-4489-8248-b672c3aee706 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] 10.222.0.48 "GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9" status: 200 len: 1211 microversion: 2.1 time: 0.472630 Apr 08 02:44:41.732125 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 13/24] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:44:41 2022] GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9 => generated 1211 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:44:42.605119 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-d3d90b16-6211-4ef5-a241-177a763bab74 tempest-VolumesSnapshotsTestJSON-56616674 tempest-VolumesSnapshotsTestJSON-56616674-project] Calling method '.version_select at 0x7f7d4e5835e0>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:42.766046 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-e5279671-4ad6-4d15-9120-00a1458d3000 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:42.767634 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-e5279671-4ad6-4d15-9120-00a1458d3000 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] [instance: 2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:44:42.801829 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-d3d90b16-6211-4ef5-a241-177a763bab74 tempest-VolumesSnapshotsTestJSON-56616674 tempest-VolumesSnapshotsTestJSON-56616674-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/3ed97e3a-8917-41e9-88cb-b58641c59153" status: 200 len: 286 microversion: 2.1 time: 0.209192 Apr 08 02:44:42.802819 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 12/25] 10.222.0.48 () {58 vars in 1250 bytes} [Fri Apr 8 02:44:42 2022] GET /compute/v2.1/os-snapshots/3ed97e3a-8917-41e9-88cb-b58641c59153 => generated 286 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:44:42.812486 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-e5279671-4ad6-4d15-9120-00a1458d3000 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:42.825425 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-e5279671-4ad6-4d15-9120-00a1458d3000 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:42.826654 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-e5279671-4ad6-4d15-9120-00a1458d3000 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:42.831200 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-63cdb5b8-ed26-4bde-ba1e-e43fa1b3cb76 tempest-VolumesSnapshotsTestJSON-56616674 tempest-VolumesSnapshotsTestJSON-56616674-project] Calling method '.version_select at 0x7f7d4e5ddee0>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:42.832259 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-e5279671-4ad6-4d15-9120-00a1458d3000 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:43.175583 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-63cdb5b8-ed26-4bde-ba1e-e43fa1b3cb76 tempest-VolumesSnapshotsTestJSON-56616674 tempest-VolumesSnapshotsTestJSON-56616674-project] 10.222.0.48 "DELETE /compute/v2.1/os-snapshots/3ed97e3a-8917-41e9-88cb-b58641c59153" status: 202 len: 0 microversion: 2.1 time: 0.365779 Apr 08 02:44:43.176844 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 13/26] 10.222.0.48 () {58 vars in 1253 bytes} [Fri Apr 8 02:44:42 2022] DELETE /compute/v2.1/os-snapshots/3ed97e3a-8917-41e9-88cb-b58641c59153 => generated 0 bytes in 368 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 02:44:43.198060 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-0f9432a6-801c-40ce-ba70-5b479bc2f625 tempest-VolumesSnapshotsTestJSON-56616674 tempest-VolumesSnapshotsTestJSON-56616674-project] Calling method '.version_select at 0x7f7d4e571d30>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:43.301009 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-0f9432a6-801c-40ce-ba70-5b479bc2f625 tempest-VolumesSnapshotsTestJSON-56616674 tempest-VolumesSnapshotsTestJSON-56616674-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/3ed97e3a-8917-41e9-88cb-b58641c59153" status: 200 len: 285 microversion: 2.1 time: 0.119530 Apr 08 02:44:43.301822 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 14/27] 10.222.0.48 () {58 vars in 1250 bytes} [Fri Apr 8 02:44:43 2022] GET /compute/v2.1/os-snapshots/3ed97e3a-8917-41e9-88cb-b58641c59153 => generated 285 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 02:44:43.617507 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-e5279671-4ad6-4d15-9120-00a1458d3000 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246bad06441497e9fd542cc1c84da0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ab2bde6dca4830a67ca00d0223b3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:44:43.636916 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-e5279671-4ad6-4d15-9120-00a1458d3000 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] 10.222.0.48 "GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9" status: 200 len: 1285 microversion: 2.1 time: 0.891204 Apr 08 02:44:43.643387 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 14/28] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:44:42 2022] GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9 => generated 1285 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:44:44.325006 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-258caabd-c15f-45a9-9dd7-ad34a9932d24 tempest-VolumesSnapshotsTestJSON-56616674 tempest-VolumesSnapshotsTestJSON-56616674-project] Calling method '.version_select at 0x7f7d4e583280>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:44.541980 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.wsgi [None req-258caabd-c15f-45a9-9dd7-ad34a9932d24 tempest-VolumesSnapshotsTestJSON-56616674 tempest-VolumesSnapshotsTestJSON-56616674-project] HTTP exception thrown: Snapshot 3ed97e3a-8917-41e9-88cb-b58641c59153 could not be found. Apr 08 02:44:44.543055 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-258caabd-c15f-45a9-9dd7-ad34a9932d24 tempest-VolumesSnapshotsTestJSON-56616674 tempest-VolumesSnapshotsTestJSON-56616674-project] Returning 404 to user: Snapshot 3ed97e3a-8917-41e9-88cb-b58641c59153 could not be found. {{(pid=96920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Apr 08 02:44:44.544294 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-258caabd-c15f-45a9-9dd7-ad34a9932d24 tempest-VolumesSnapshotsTestJSON-56616674 tempest-VolumesSnapshotsTestJSON-56616674-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/3ed97e3a-8917-41e9-88cb-b58641c59153" status: 404 len: 111 microversion: 2.1 time: 0.234474 Apr 08 02:44:44.545219 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 15/29] 10.222.0.48 () {58 vars in 1250 bytes} [Fri Apr 8 02:44:44 2022] GET /compute/v2.1/os-snapshots/3ed97e3a-8917-41e9-88cb-b58641c59153 => generated 111 bytes in 236 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 02:44:44.571503 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-2a076a2d-c852-4595-84eb-123a17522315 tempest-VolumesSnapshotsTestJSON-56616674 tempest-VolumesSnapshotsTestJSON-56616674-project] Calling method '.version_select at 0x7f7d4e5ca8b0>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:44.685899 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-04e25151-edb3-4018-9225-fd7d08feeb5f tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:44.686534 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-04e25151-edb3-4018-9225-fd7d08feeb5f tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] [instance: 2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:44:44.731019 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-04e25151-edb3-4018-9225-fd7d08feeb5f tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:44.731990 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-04e25151-edb3-4018-9225-fd7d08feeb5f tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:44.737219 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-04e25151-edb3-4018-9225-fd7d08feeb5f tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:44.738506 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-04e25151-edb3-4018-9225-fd7d08feeb5f tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:44.884188 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-2a076a2d-c852-4595-84eb-123a17522315 tempest-VolumesSnapshotsTestJSON-56616674 tempest-VolumesSnapshotsTestJSON-56616674-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/145dc661-0c3f-4f93-944a-3dbed75b35e6" status: 202 len: 0 microversion: 2.1 time: 0.333252 Apr 08 02:44:44.886080 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 15/30] 10.222.0.48 () {58 vars in 1247 bytes} [Fri Apr 8 02:44:44 2022] DELETE /compute/v2.1/os-volumes/145dc661-0c3f-4f93-944a-3dbed75b35e6 => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 02:44:44.912832 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-45676f63-d54a-48e7-bd4a-35f679c6776c tempest-VolumesSnapshotsTestJSON-56616674 tempest-VolumesSnapshotsTestJSON-56616674-project] Calling method '.version_select at 0x7f7d4e5d3310>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:45.159483 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.wsgi [None req-45676f63-d54a-48e7-bd4a-35f679c6776c tempest-VolumesSnapshotsTestJSON-56616674 tempest-VolumesSnapshotsTestJSON-56616674-project] HTTP exception thrown: Volume 145dc661-0c3f-4f93-944a-3dbed75b35e6 could not be found. Apr 08 02:44:45.161146 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-45676f63-d54a-48e7-bd4a-35f679c6776c tempest-VolumesSnapshotsTestJSON-56616674 tempest-VolumesSnapshotsTestJSON-56616674-project] Returning 404 to user: Volume 145dc661-0c3f-4f93-944a-3dbed75b35e6 could not be found. {{(pid=96919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Apr 08 02:44:45.162188 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-45676f63-d54a-48e7-bd4a-35f679c6776c tempest-VolumesSnapshotsTestJSON-56616674 tempest-VolumesSnapshotsTestJSON-56616674-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/145dc661-0c3f-4f93-944a-3dbed75b35e6" status: 404 len: 109 microversion: 2.1 time: 0.271554 Apr 08 02:44:45.163141 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 16/31] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Apr 8 02:44:44 2022] GET /compute/v2.1/os-volumes/145dc661-0c3f-4f93-944a-3dbed75b35e6 => generated 109 bytes in 273 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 08 02:44:45.231690 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-1ddd9d01-4e6a-4513-aff2-ab36e35651f2 tempest-VolumesSnapshotsTestJSON-56616674 tempest-VolumesSnapshotsTestJSON-56616674-project] Calling method '.version_select at 0x7f7d4e5d3ee0>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:45.387933 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-04e25151-edb3-4018-9225-fd7d08feeb5f tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246bad06441497e9fd542cc1c84da0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ab2bde6dca4830a67ca00d0223b3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:44:45.447406 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-04e25151-edb3-4018-9225-fd7d08feeb5f tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] 10.222.0.48 "GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9" status: 200 len: 1273 microversion: 2.1 time: 0.792731 Apr 08 02:44:45.451364 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 16/32] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:44:44 2022] GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9 => generated 1273 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:44:45.537990 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.wsgi [None req-1ddd9d01-4e6a-4513-aff2-ab36e35651f2 tempest-VolumesSnapshotsTestJSON-56616674 tempest-VolumesSnapshotsTestJSON-56616674-project] HTTP exception thrown: Volume 145dc661-0c3f-4f93-944a-3dbed75b35e6 could not be found. Apr 08 02:44:45.538842 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-1ddd9d01-4e6a-4513-aff2-ab36e35651f2 tempest-VolumesSnapshotsTestJSON-56616674 tempest-VolumesSnapshotsTestJSON-56616674-project] Returning 404 to user: Volume 145dc661-0c3f-4f93-944a-3dbed75b35e6 could not be found. {{(pid=96919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Apr 08 02:44:45.540132 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-1ddd9d01-4e6a-4513-aff2-ab36e35651f2 tempest-VolumesSnapshotsTestJSON-56616674 tempest-VolumesSnapshotsTestJSON-56616674-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/145dc661-0c3f-4f93-944a-3dbed75b35e6" status: 404 len: 109 microversion: 2.1 time: 0.371547 Apr 08 02:44:45.541253 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 17/33] 10.222.0.48 () {58 vars in 1247 bytes} [Fri Apr 8 02:44:45 2022] DELETE /compute/v2.1/os-volumes/145dc661-0c3f-4f93-944a-3dbed75b35e6 => generated 109 bytes in 373 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 02:44:45.575305 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-ca75ea9f-78f4-4208-a0a9-eb5e4652481d tempest-VolumesSnapshotsTestJSON-56616674 tempest-VolumesSnapshotsTestJSON-56616674-project] Calling method '.version_select at 0x7f7d4e4ef160>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:45.875790 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.wsgi [None req-ca75ea9f-78f4-4208-a0a9-eb5e4652481d tempest-VolumesSnapshotsTestJSON-56616674 tempest-VolumesSnapshotsTestJSON-56616674-project] HTTP exception thrown: Volume 145dc661-0c3f-4f93-944a-3dbed75b35e6 could not be found. Apr 08 02:44:45.876515 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-ca75ea9f-78f4-4208-a0a9-eb5e4652481d tempest-VolumesSnapshotsTestJSON-56616674 tempest-VolumesSnapshotsTestJSON-56616674-project] Returning 404 to user: Volume 145dc661-0c3f-4f93-944a-3dbed75b35e6 could not be found. {{(pid=96920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Apr 08 02:44:45.877583 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-ca75ea9f-78f4-4208-a0a9-eb5e4652481d tempest-VolumesSnapshotsTestJSON-56616674 tempest-VolumesSnapshotsTestJSON-56616674-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/145dc661-0c3f-4f93-944a-3dbed75b35e6" status: 404 len: 109 microversion: 2.1 time: 0.332582 Apr 08 02:44:45.878443 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 17/34] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Apr 8 02:44:45 2022] GET /compute/v2.1/os-volumes/145dc661-0c3f-4f93-944a-3dbed75b35e6 => generated 109 bytes in 334 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 02:44:46.495107 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-baba20a4-a5b4-43c6-acdc-4f3cb85505e0 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:46.496827 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-baba20a4-a5b4-43c6-acdc-4f3cb85505e0 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] [instance: 2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:44:46.553769 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-baba20a4-a5b4-43c6-acdc-4f3cb85505e0 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:46.554002 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-baba20a4-a5b4-43c6-acdc-4f3cb85505e0 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:46.557456 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-baba20a4-a5b4-43c6-acdc-4f3cb85505e0 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:46.563159 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-baba20a4-a5b4-43c6-acdc-4f3cb85505e0 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:47.213570 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-baba20a4-a5b4-43c6-acdc-4f3cb85505e0 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246bad06441497e9fd542cc1c84da0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ab2bde6dca4830a67ca00d0223b3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:44:47.245791 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-baba20a4-a5b4-43c6-acdc-4f3cb85505e0 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] 10.222.0.48 "GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9" status: 200 len: 1273 microversion: 2.1 time: 0.781364 Apr 08 02:44:47.257979 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 18/35] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:44:46 2022] GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9 => generated 1273 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:44:48.304054 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-2819b26f-c037-4899-9b0b-13fc385f6e93 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:48.304800 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-2819b26f-c037-4899-9b0b-13fc385f6e93 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] [instance: 2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:44:48.331306 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-2819b26f-c037-4899-9b0b-13fc385f6e93 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:48.341831 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-2819b26f-c037-4899-9b0b-13fc385f6e93 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:48.343987 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-2819b26f-c037-4899-9b0b-13fc385f6e93 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:48.346247 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-2819b26f-c037-4899-9b0b-13fc385f6e93 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:48.395626 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-69663d84-fc19-4135-b379-77875804ffaf tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Action: 'create', calling method: .version_select at 0x7f7d4e5ddca0>, body: {"keypair": {"name": "tempest-keypair-955893127"}} {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:44:48.589247 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.quota [None req-69663d84-fc19-4135-b379-77875804ffaf tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Getting quotas for project f673f0f0edd74c56a204930e93f143da. Resources: {'key_pairs'} {{(pid=96920) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:44:48.602367 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.quota [None req-69663d84-fc19-4135-b379-77875804ffaf tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Getting quotas for user f7cf97b0aa15496393f1a39d5ef759de and project f673f0f0edd74c56a204930e93f143da. Resources: {'key_pairs'} {{(pid=96920) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:44:48.706081 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-2819b26f-c037-4899-9b0b-13fc385f6e93 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246bad06441497e9fd542cc1c84da0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ab2bde6dca4830a67ca00d0223b3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:44:48.743272 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-2819b26f-c037-4899-9b0b-13fc385f6e93 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] 10.222.0.48 "GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9" status: 200 len: 1273 microversion: 2.1 time: 0.468128 Apr 08 02:44:48.756816 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 19/36] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:44:48 2022] GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9 => generated 1273 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:44:49.576466 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.quota [None req-69663d84-fc19-4135-b379-77875804ffaf tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Getting quotas for project f673f0f0edd74c56a204930e93f143da. Resources: {'key_pairs'} {{(pid=96920) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:44:49.606813 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.quota [None req-69663d84-fc19-4135-b379-77875804ffaf tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Getting quotas for user f7cf97b0aa15496393f1a39d5ef759de and project f673f0f0edd74c56a204930e93f143da. Resources: {'key_pairs'} {{(pid=96920) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:44:49.656355 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-69663d84-fc19-4135-b379-77875804ffaf tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 1.679991 Apr 08 02:44:49.659201 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 18/37] 10.222.0.48 () {62 vars in 1198 bytes} [Fri Apr 8 02:44:47 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 1684 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Apr 08 02:44:49.776399 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-89b574f9-9654-4653-980b-75b693f22b49 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:49.777052 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-89b574f9-9654-4653-980b-75b693f22b49 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] [instance: 2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:44:49.806419 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-89b574f9-9654-4653-980b-75b693f22b49 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:49.816804 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-89b574f9-9654-4653-980b-75b693f22b49 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:49.817610 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-89b574f9-9654-4653-980b-75b693f22b49 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:49.819116 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-89b574f9-9654-4653-980b-75b693f22b49 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:51.874829 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-89b574f9-9654-4653-980b-75b693f22b49 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246bad06441497e9fd542cc1c84da0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ab2bde6dca4830a67ca00d0223b3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:44:51.894878 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-89b574f9-9654-4653-980b-75b693f22b49 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] 10.222.0.48 "GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9" status: 200 len: 1315 microversion: 2.1 time: 2.132880 Apr 08 02:44:51.895792 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 20/38] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:44:49 2022] GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9 => generated 1315 bytes in 2136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:44:52.918973 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-a96708a7-c452-4910-aea5-b073a95ecf66 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:52.919591 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-a96708a7-c452-4910-aea5-b073a95ecf66 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] [instance: 2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:44:52.939593 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-a96708a7-c452-4910-aea5-b073a95ecf66 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:52.940296 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-a96708a7-c452-4910-aea5-b073a95ecf66 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:52.941218 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-a96708a7-c452-4910-aea5-b073a95ecf66 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:52.942537 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-a96708a7-c452-4910-aea5-b073a95ecf66 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:53.937670 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-a96708a7-c452-4910-aea5-b073a95ecf66 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246bad06441497e9fd542cc1c84da0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ab2bde6dca4830a67ca00d0223b3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:44:53.967296 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-a96708a7-c452-4910-aea5-b073a95ecf66 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] 10.222.0.48 "GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9" status: 200 len: 1315 microversion: 2.1 time: 1.057751 Apr 08 02:44:53.969702 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 19/39] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:44:52 2022] GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9 => generated 1315 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:44:54.997104 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-b0652efd-dc0a-4ee2-b62d-bbed329c33d8 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:54.998361 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-b0652efd-dc0a-4ee2-b62d-bbed329c33d8 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] [instance: 2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:44:55.040204 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b0652efd-dc0a-4ee2-b62d-bbed329c33d8 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:55.043699 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b0652efd-dc0a-4ee2-b62d-bbed329c33d8 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:55.044892 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b0652efd-dc0a-4ee2-b62d-bbed329c33d8 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:55.047921 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b0652efd-dc0a-4ee2-b62d-bbed329c33d8 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:56.485015 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-e092804e-3322-45c3-b563-b3f3d68312b1 tempest-VolumesGetTestJSON-434762495 tempest-VolumesGetTestJSON-434762495-project] Action: 'create', calling method: .version_select at 0x7f7d4e521d30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-529554612", "metadata": {"Type": "work"}}} {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:44:56.780773 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-b0652efd-dc0a-4ee2-b62d-bbed329c33d8 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246bad06441497e9fd542cc1c84da0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ab2bde6dca4830a67ca00d0223b3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:44:56.798990 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-b0652efd-dc0a-4ee2-b62d-bbed329c33d8 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] 10.222.0.48 "GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9" status: 200 len: 1315 microversion: 2.1 time: 1.818039 Apr 08 02:44:56.799702 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 21/40] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:44:54 2022] GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9 => generated 1315 bytes in 1820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:44:57.358443 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [req-3b78d9bd-9156-46b5-bb6c-f65093b185b9 req-9d4a1b46-ebe3-4637-82e4-5682a3bd5880 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9", "tag": "44289cfd-1a39-4ed4-8b1c-43f7bf303706"}]} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:44:57.409013 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:44:57.409013 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: warnings.warn(msg) Apr 08 02:44:57.446142 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-3b78d9bd-9156-46b5-bb6c-f65093b185b9 req-9d4a1b46-ebe3-4637-82e4-5682a3bd5880 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:57.446654 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-3b78d9bd-9156-46b5-bb6c-f65093b185b9 req-9d4a1b46-ebe3-4637-82e4-5682a3bd5880 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:57.512602 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.compute.server_external_events [req-3b78d9bd-9156-46b5-bb6c-f65093b185b9 req-9d4a1b46-ebe3-4637-82e4-5682a3bd5880 service nova] Creating event network-changed:44289cfd-1a39-4ed4-8b1c-43f7bf303706 for instance 2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9 on hv-cinder-83705 Apr 08 02:44:57.513167 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-3b78d9bd-9156-46b5-bb6c-f65093b185b9 req-9d4a1b46-ebe3-4637-82e4-5682a3bd5880 service nova] Acquired lock "compute-rpcapi-router" {{(pid=96919) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Apr 08 02:44:57.514458 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-f350abe5-207c-4a17-8757-96884db4c2f8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:57.517652 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-f350abe5-207c-4a17-8757-96884db4c2f8 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:57.522379 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-f350abe5-207c-4a17-8757-96884db4c2f8 None None] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:57.523081 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-f350abe5-207c-4a17-8757-96884db4c2f8 None None] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:57.547814 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.compute.rpcapi [None req-f350abe5-207c-4a17-8757-96884db4c2f8 None None] Automatically selected compute RPC version 5.12 from minimum service version 53 Apr 08 02:44:57.548981 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-f350abe5-207c-4a17-8757-96884db4c2f8 None None] Releasing lock "compute-rpcapi-router" {{(pid=96919) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Apr 08 02:44:57.620888 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-f350abe5-207c-4a17-8757-96884db4c2f8 None None] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.818692 Apr 08 02:44:57.624905 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 22/41] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:44:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:44:57.776798 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-e092804e-3322-45c3-b563-b3f3d68312b1 tempest-VolumesGetTestJSON-434762495 tempest-VolumesGetTestJSON-434762495-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 1.770077 Apr 08 02:44:57.777779 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 20/42] 10.222.0.48 () {60 vars in 1155 bytes} [Fri Apr 8 02:44:56 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 1772 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Apr 08 02:44:57.808797 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-86c36976-4c56-4a3f-87d6-ed236c64a40f tempest-VolumesGetTestJSON-434762495 tempest-VolumesGetTestJSON-434762495-project] Calling method '.version_select at 0x7f7d4e6ed5e0>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:57.846783 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-55a32883-ab9b-4257-8e78-9821e1c0ff1a tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:57.855180 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-55a32883-ab9b-4257-8e78-9821e1c0ff1a tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] [instance: 2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:44:57.928062 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-55a32883-ab9b-4257-8e78-9821e1c0ff1a tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:57.957052 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-55a32883-ab9b-4257-8e78-9821e1c0ff1a tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:57.963023 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-55a32883-ab9b-4257-8e78-9821e1c0ff1a tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:44:57.963567 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-55a32883-ab9b-4257-8e78-9821e1c0ff1a tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:44:58.211953 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-86c36976-4c56-4a3f-87d6-ed236c64a40f tempest-VolumesGetTestJSON-434762495 tempest-VolumesGetTestJSON-434762495-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/ed83bb62-9161-43a5-b1d4-8c0e6acdbe05" status: 200 len: 352 microversion: 2.1 time: 0.422691 Apr 08 02:44:58.213526 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 23/43] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Apr 8 02:44:57 2022] GET /compute/v2.1/os-volumes/ed83bb62-9161-43a5-b1d4-8c0e6acdbe05 => generated 352 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:44:59.315404 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-ea3c1293-52a8-40f4-82e9-41eaaf061a7b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-503196732", "imageRef": "7f8ca061-f382-4052-8d05-69f37e107684", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:44:59.355235 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-55a32883-ab9b-4257-8e78-9821e1c0ff1a tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246bad06441497e9fd542cc1c84da0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ab2bde6dca4830a67ca00d0223b3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:44:59.375998 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-55a32883-ab9b-4257-8e78-9821e1c0ff1a tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] 10.222.0.48 "GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9" status: 200 len: 1315 microversion: 2.1 time: 1.562608 Apr 08 02:44:59.387043 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 21/44] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:44:57 2022] GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9 => generated 1315 bytes in 1574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:44:59.412966 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-6ed25999-0eed-4aa9-9d2d-9f52ae770a70 tempest-VolumesGetTestJSON-434762495 tempest-VolumesGetTestJSON-434762495-project] Calling method '.version_select at 0x7f7d4e5213a0>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:59.680288 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-6ed25999-0eed-4aa9-9d2d-9f52ae770a70 tempest-VolumesGetTestJSON-434762495 tempest-VolumesGetTestJSON-434762495-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/ed83bb62-9161-43a5-b1d4-8c0e6acdbe05" status: 200 len: 353 microversion: 2.1 time: 0.291939 Apr 08 02:44:59.681176 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 22/45] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Apr 8 02:44:59 2022] GET /compute/v2.1/os-volumes/ed83bb62-9161-43a5-b1d4-8c0e6acdbe05 => generated 353 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:44:59.704405 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-645d8817-3e6d-42f0-a377-6461d309e093 tempest-VolumesGetTestJSON-434762495 tempest-VolumesGetTestJSON-434762495-project] Calling method '.version_select at 0x7f7d4e53bd30>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:59.903509 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-645d8817-3e6d-42f0-a377-6461d309e093 tempest-VolumesGetTestJSON-434762495 tempest-VolumesGetTestJSON-434762495-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/ed83bb62-9161-43a5-b1d4-8c0e6acdbe05" status: 200 len: 353 microversion: 2.1 time: 0.214152 Apr 08 02:44:59.915515 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 23/46] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Apr 8 02:44:59 2022] GET /compute/v2.1/os-volumes/ed83bb62-9161-43a5-b1d4-8c0e6acdbe05 => generated 353 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:44:59.931205 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-5f4a9def-81c7-4c26-ae60-fc69f5b04141 tempest-VolumesGetTestJSON-434762495 tempest-VolumesGetTestJSON-434762495-project] Calling method '.version_select at 0x7f7d4e53b670>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:44:59.995081 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.network.neutron [None req-ea3c1293-52a8-40f4-82e9-41eaaf061a7b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] validate_networks() for [('0f7fec88-7d49-4f5a-9423-d79ffd9641f1', None, None, None)] {{(pid=96919) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} Apr 08 02:45:00.211744 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-5f4a9def-81c7-4c26-ae60-fc69f5b04141 tempest-VolumesGetTestJSON-434762495 tempest-VolumesGetTestJSON-434762495-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/ed83bb62-9161-43a5-b1d4-8c0e6acdbe05" status: 202 len: 0 microversion: 2.1 time: 0.290968 Apr 08 02:45:00.212830 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 24/47] 10.222.0.48 () {58 vars in 1247 bytes} [Fri Apr 8 02:44:59 2022] DELETE /compute/v2.1/os-volumes/ed83bb62-9161-43a5-b1d4-8c0e6acdbe05 => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 08 02:45:00.227886 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-67389b09-078d-43ac-84cd-bbaf1736355f tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1931253760", "imageRef": "7f8ca061-f382-4052-8d05-69f37e107684", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9177d28f-82e1-4f7a-9248-434f10dfbba9"}], "security_groups": [{"name": "tempest-securitygroup--1218131913"}], "key_name": "tempest-keypair-955893127", "user_data": "}} {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:45:00.514828 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.network.neutron [None req-67389b09-078d-43ac-84cd-bbaf1736355f tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] validate_networks() for [('9177d28f-82e1-4f7a-9248-434f10dfbba9', None, None, None)] {{(pid=96920) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} Apr 08 02:45:01.438804 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.virt.hardware [None req-67389b09-078d-43ac-84cd-bbaf1736355f tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Flavor limits 0:0:0 {{(pid=96920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} Apr 08 02:45:01.439305 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.virt.hardware [None req-67389b09-078d-43ac-84cd-bbaf1736355f tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Image limits 0:0:0 {{(pid=96920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} Apr 08 02:45:01.439870 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.virt.hardware [None req-67389b09-078d-43ac-84cd-bbaf1736355f tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Flavor pref 0:0:0 {{(pid=96920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} Apr 08 02:45:01.440351 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.virt.hardware [None req-67389b09-078d-43ac-84cd-bbaf1736355f tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Image pref 0:0:0 {{(pid=96920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} Apr 08 02:45:01.440833 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.virt.hardware [None req-67389b09-078d-43ac-84cd-bbaf1736355f tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=96920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} Apr 08 02:45:01.462922 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-67389b09-078d-43ac-84cd-bbaf1736355f tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:01.463377 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-67389b09-078d-43ac-84cd-bbaf1736355f tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:01.464183 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-67389b09-078d-43ac-84cd-bbaf1736355f tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:01.464620 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-67389b09-078d-43ac-84cd-bbaf1736355f tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:01.500977 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.quota [None req-67389b09-078d-43ac-84cd-bbaf1736355f tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Getting quotas for project f673f0f0edd74c56a204930e93f143da. Resources: {'instances', 'cores', 'ram'} {{(pid=96920) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:45:01.507636 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.quota [None req-67389b09-078d-43ac-84cd-bbaf1736355f tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Getting quotas for user f7cf97b0aa15496393f1a39d5ef759de and project f673f0f0edd74c56a204930e93f143da. Resources: {'instances', 'cores', 'ram'} {{(pid=96920) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:45:01.523637 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-67389b09-078d-43ac-84cd-bbaf1736355f tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Going to run 1 instances... {{(pid=96920) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} Apr 08 02:45:01.527032 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-67389b09-078d-43ac-84cd-bbaf1736355f tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7f8ca061-f382-4052-8d05-69f37e107684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=96920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} Apr 08 02:45:01.594456 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-67389b09-078d-43ac-84cd-bbaf1736355f tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.380124 Apr 08 02:45:01.595154 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 25/48] 10.222.0.48 () {62 vars in 1187 bytes} [Fri Apr 8 02:45:00 2022] POST /compute/v2.1/servers => generated 402 bytes in 1382 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 08 02:45:01.616906 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-bd293cc7-ee72-470b-bab8-46b2944b1eb8 tempest-VolumesGetTestJSON-434762495 tempest-VolumesGetTestJSON-434762495-project] Calling method '.version_select at 0x7f7d4e521d30>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:01.763724 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.wsgi [None req-bd293cc7-ee72-470b-bab8-46b2944b1eb8 tempest-VolumesGetTestJSON-434762495 tempest-VolumesGetTestJSON-434762495-project] HTTP exception thrown: Volume ed83bb62-9161-43a5-b1d4-8c0e6acdbe05 could not be found. Apr 08 02:45:01.764629 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-bd293cc7-ee72-470b-bab8-46b2944b1eb8 tempest-VolumesGetTestJSON-434762495 tempest-VolumesGetTestJSON-434762495-project] Returning 404 to user: Volume ed83bb62-9161-43a5-b1d4-8c0e6acdbe05 could not be found. {{(pid=96920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Apr 08 02:45:01.765596 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-bd293cc7-ee72-470b-bab8-46b2944b1eb8 tempest-VolumesGetTestJSON-434762495 tempest-VolumesGetTestJSON-434762495-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/ed83bb62-9161-43a5-b1d4-8c0e6acdbe05" status: 404 len: 109 microversion: 2.1 time: 0.169286 Apr 08 02:45:01.766732 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 26/49] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Apr 8 02:45:01 2022] GET /compute/v2.1/os-volumes/ed83bb62-9161-43a5-b1d4-8c0e6acdbe05 => generated 109 bytes in 171 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 02:45:01.793701 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-35a7519a-02f1-4542-a268-eaf85d5a9aaf tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:01.796192 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-35a7519a-02f1-4542-a268-eaf85d5a9aaf tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] [instance: 2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:01.829140 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-35a7519a-02f1-4542-a268-eaf85d5a9aaf tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:01.831412 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-35a7519a-02f1-4542-a268-eaf85d5a9aaf tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:01.832545 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-35a7519a-02f1-4542-a268-eaf85d5a9aaf tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:01.834738 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-35a7519a-02f1-4542-a268-eaf85d5a9aaf tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:02.604972 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.virt.hardware [None req-ea3c1293-52a8-40f4-82e9-41eaaf061a7b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Flavor limits 0:0:0 {{(pid=96919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} Apr 08 02:45:02.606556 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.virt.hardware [None req-ea3c1293-52a8-40f4-82e9-41eaaf061a7b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Image limits 0:0:0 {{(pid=96919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} Apr 08 02:45:02.607239 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.virt.hardware [None req-ea3c1293-52a8-40f4-82e9-41eaaf061a7b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Flavor pref 0:0:0 {{(pid=96919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} Apr 08 02:45:02.608242 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.virt.hardware [None req-ea3c1293-52a8-40f4-82e9-41eaaf061a7b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Image pref 0:0:0 {{(pid=96919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} Apr 08 02:45:02.609562 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.virt.hardware [None req-ea3c1293-52a8-40f4-82e9-41eaaf061a7b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=96919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} Apr 08 02:45:02.616096 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-35a7519a-02f1-4542-a268-eaf85d5a9aaf tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246bad06441497e9fd542cc1c84da0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ab2bde6dca4830a67ca00d0223b3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:02.629804 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-35a7519a-02f1-4542-a268-eaf85d5a9aaf tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] 10.222.0.48 "GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9" status: 200 len: 1315 microversion: 2.1 time: 0.861388 Apr 08 02:45:02.630573 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 27/50] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:01 2022] GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9 => generated 1315 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:02.641700 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ea3c1293-52a8-40f4-82e9-41eaaf061a7b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:02.642157 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ea3c1293-52a8-40f4-82e9-41eaaf061a7b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:02.642996 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ea3c1293-52a8-40f4-82e9-41eaaf061a7b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:02.643432 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ea3c1293-52a8-40f4-82e9-41eaaf061a7b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:02.712384 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.quota [None req-ea3c1293-52a8-40f4-82e9-41eaaf061a7b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Getting quotas for project 2f0c4cd55acc4607852747c5d796609e. Resources: {'instances', 'cores', 'ram'} {{(pid=96919) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:45:02.720454 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.quota [None req-ea3c1293-52a8-40f4-82e9-41eaaf061a7b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Getting quotas for user 153666ecd9c84936bd1c9ce32373ca27 and project 2f0c4cd55acc4607852747c5d796609e. Resources: {'instances', 'cores', 'ram'} {{(pid=96919) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:45:02.734302 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-ea3c1293-52a8-40f4-82e9-41eaaf061a7b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Going to run 1 instances... {{(pid=96919) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} Apr 08 02:45:02.737445 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-ea3c1293-52a8-40f4-82e9-41eaaf061a7b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: fe2c4fd0-315a-4d94-8913-a661cdfa293a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7f8ca061-f382-4052-8d05-69f37e107684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=96919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} Apr 08 02:45:02.855992 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-ea3c1293-52a8-40f4-82e9-41eaaf061a7b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.927058 Apr 08 02:45:02.860148 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 24/51] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Apr 8 02:44:58 2022] POST /compute/v2.1/servers => generated 383 bytes in 3932 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 08 02:45:02.908136 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-b2da7cc8-b108-46ff-b507-dd8c42e62e3b tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:02.908906 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-b2da7cc8-b108-46ff-b507-dd8c42e62e3b tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:02.941275 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b2da7cc8-b108-46ff-b507-dd8c42e62e3b tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:02.944272 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b2da7cc8-b108-46ff-b507-dd8c42e62e3b tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:02.946345 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b2da7cc8-b108-46ff-b507-dd8c42e62e3b tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:02.947164 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b2da7cc8-b108-46ff-b507-dd8c42e62e3b tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:03.339461 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-7d855054-b90e-4f1b-b943-56b8a7fd4fe1 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Action: 'create', calling method: .version_select at 0x7f7d4e521670>, body: {"keypair": {"name": "tempest-keypair-89554807"}} {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:45:03.494136 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.quota [None req-7d855054-b90e-4f1b-b943-56b8a7fd4fe1 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Getting quotas for project cbbf5bb7e51d4d2d8594d6d1d3a797a3. Resources: {'key_pairs'} {{(pid=96920) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:45:03.524625 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-b2da7cc8-b108-46ff-b507-dd8c42e62e3b tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:03.560604 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.quota [None req-7d855054-b90e-4f1b-b943-56b8a7fd4fe1 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Getting quotas for user b68bc45984974d6da1c9151c21dae14c and project cbbf5bb7e51d4d2d8594d6d1d3a797a3. Resources: {'key_pairs'} {{(pid=96920) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:45:03.592114 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-b2da7cc8-b108-46ff-b507-dd8c42e62e3b tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:03.602215 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-b2da7cc8-b108-46ff-b507-dd8c42e62e3b tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:03.617959 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-b2da7cc8-b108-46ff-b507-dd8c42e62e3b tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1285 microversion: 2.20 time: 0.756296 Apr 08 02:45:03.618604 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 25/52] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:45:02 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1285 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:45:03.673888 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-b9aab1b2-5b70-4a54-a814-973b3bbe65a6 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:03.679793 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-b9aab1b2-5b70-4a54-a814-973b3bbe65a6 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: fe2c4fd0-315a-4d94-8913-a661cdfa293a] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:03.838404 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-b9aab1b2-5b70-4a54-a814-973b3bbe65a6 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:03.882072 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-b9aab1b2-5b70-4a54-a814-973b3bbe65a6 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/fe2c4fd0-315a-4d94-8913-a661cdfa293a" status: 200 len: 1221 microversion: 2.1 time: 0.252333 Apr 08 02:45:03.899882 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 26/53] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:03 2022] GET /compute/v2.1/servers/fe2c4fd0-315a-4d94-8913-a661cdfa293a => generated 1221 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:03.935395 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-93a0c8ec-d0e5-4906-b305-d5c2b9b8b6dd tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:03.937807 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-93a0c8ec-d0e5-4906-b305-d5c2b9b8b6dd tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] [instance: 2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:03.969450 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-93a0c8ec-d0e5-4906-b305-d5c2b9b8b6dd tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:03.970069 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-93a0c8ec-d0e5-4906-b305-d5c2b9b8b6dd tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:03.977338 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-93a0c8ec-d0e5-4906-b305-d5c2b9b8b6dd tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:03.979315 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-93a0c8ec-d0e5-4906-b305-d5c2b9b8b6dd tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:04.419756 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.quota [None req-7d855054-b90e-4f1b-b943-56b8a7fd4fe1 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Getting quotas for project cbbf5bb7e51d4d2d8594d6d1d3a797a3. Resources: {'key_pairs'} {{(pid=96920) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:45:04.432241 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.quota [None req-7d855054-b90e-4f1b-b943-56b8a7fd4fe1 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Getting quotas for user b68bc45984974d6da1c9151c21dae14c and project cbbf5bb7e51d4d2d8594d6d1d3a797a3. Resources: {'key_pairs'} {{(pid=96920) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:45:04.472709 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-7d855054-b90e-4f1b-b943-56b8a7fd4fe1 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 2303 microversion: 2.1 time: 1.840674 Apr 08 02:45:04.475113 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 28/54] 10.222.0.48 () {60 vars in 1157 bytes} [Fri Apr 8 02:45:02 2022] POST /compute/v2.1/os-keypairs => generated 2303 bytes in 1844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:04.512203 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-6e8853b0-1201-435f-b0b2-4c8878116b2d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-360955517", "imageRef": "7f8ca061-f382-4052-8d05-69f37e107684", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:45:04.679502 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.network.neutron [None req-6e8853b0-1201-435f-b0b2-4c8878116b2d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] validate_networks() for [('0f7fec88-7d49-4f5a-9423-d79ffd9641f1', None, None, None)] {{(pid=96920) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} Apr 08 02:45:04.761995 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-93a0c8ec-d0e5-4906-b305-d5c2b9b8b6dd tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246bad06441497e9fd542cc1c84da0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ab2bde6dca4830a67ca00d0223b3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:04.797138 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-93a0c8ec-d0e5-4906-b305-d5c2b9b8b6dd tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] 10.222.0.48 "GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9" status: 200 len: 1315 microversion: 2.1 time: 0.894355 Apr 08 02:45:04.801085 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 27/55] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:03 2022] GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9 => generated 1315 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:04.846478 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-a9801609-fc91-42b2-88f2-51412626b1e5 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:04.846992 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-a9801609-fc91-42b2-88f2-51412626b1e5 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:04.872482 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-a9801609-fc91-42b2-88f2-51412626b1e5 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:04.872940 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-a9801609-fc91-42b2-88f2-51412626b1e5 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:04.873727 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-a9801609-fc91-42b2-88f2-51412626b1e5 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:04.874164 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-a9801609-fc91-42b2-88f2-51412626b1e5 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:05.352328 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-a9801609-fc91-42b2-88f2-51412626b1e5 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:05.391483 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-a9801609-fc91-42b2-88f2-51412626b1e5 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:05.409739 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-a9801609-fc91-42b2-88f2-51412626b1e5 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:05.413420 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-a9801609-fc91-42b2-88f2-51412626b1e5 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1339 microversion: 2.20 time: 0.609199 Apr 08 02:45:05.425090 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 28/56] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:45:04 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1339 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:45:05.831057 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-40f10d29-afd1-4a4f-bb6b-31393bbf7b4e tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:05.833109 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-40f10d29-afd1-4a4f-bb6b-31393bbf7b4e tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] [instance: 2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:05.851640 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-40f10d29-afd1-4a4f-bb6b-31393bbf7b4e tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:05.853473 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-40f10d29-afd1-4a4f-bb6b-31393bbf7b4e tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:05.854437 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-40f10d29-afd1-4a4f-bb6b-31393bbf7b4e tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:05.856175 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-40f10d29-afd1-4a4f-bb6b-31393bbf7b4e tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:06.861110 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.virt.hardware [None req-6e8853b0-1201-435f-b0b2-4c8878116b2d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Flavor limits 0:0:0 {{(pid=96920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} Apr 08 02:45:06.862091 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.virt.hardware [None req-6e8853b0-1201-435f-b0b2-4c8878116b2d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Image limits 0:0:0 {{(pid=96920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} Apr 08 02:45:06.862837 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.virt.hardware [None req-6e8853b0-1201-435f-b0b2-4c8878116b2d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Flavor pref 0:0:0 {{(pid=96920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} Apr 08 02:45:06.863445 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.virt.hardware [None req-6e8853b0-1201-435f-b0b2-4c8878116b2d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Image pref 0:0:0 {{(pid=96920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} Apr 08 02:45:06.864637 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.virt.hardware [None req-6e8853b0-1201-435f-b0b2-4c8878116b2d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=96920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} Apr 08 02:45:06.875479 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-6e8853b0-1201-435f-b0b2-4c8878116b2d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:06.876324 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-6e8853b0-1201-435f-b0b2-4c8878116b2d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:06.877923 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-6e8853b0-1201-435f-b0b2-4c8878116b2d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:06.878524 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-6e8853b0-1201-435f-b0b2-4c8878116b2d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:06.902306 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.quota [None req-6e8853b0-1201-435f-b0b2-4c8878116b2d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Getting quotas for project 2f0c4cd55acc4607852747c5d796609e. Resources: {'instances', 'cores', 'ram'} {{(pid=96920) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:45:06.907667 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.quota [None req-6e8853b0-1201-435f-b0b2-4c8878116b2d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Getting quotas for user 153666ecd9c84936bd1c9ce32373ca27 and project 2f0c4cd55acc4607852747c5d796609e. Resources: {'instances', 'cores', 'ram'} {{(pid=96920) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:45:06.921765 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-6e8853b0-1201-435f-b0b2-4c8878116b2d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Going to run 1 instances... {{(pid=96920) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} Apr 08 02:45:06.924592 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-6e8853b0-1201-435f-b0b2-4c8878116b2d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 6228b11f-244d-4e25-8b1f-e19a90cc8c20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7f8ca061-f382-4052-8d05-69f37e107684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=96920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} Apr 08 02:45:06.938343 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-40f10d29-afd1-4a4f-bb6b-31393bbf7b4e tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246bad06441497e9fd542cc1c84da0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ab2bde6dca4830a67ca00d0223b3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:06.971087 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-40f10d29-afd1-4a4f-bb6b-31393bbf7b4e tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] 10.222.0.48 "GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9" status: 200 len: 1315 microversion: 2.1 time: 1.158588 Apr 08 02:45:06.979001 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 29/57] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:05 2022] GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9 => generated 1315 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:45:06.996980 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-6e8853b0-1201-435f-b0b2-4c8878116b2d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.515365 Apr 08 02:45:07.014251 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 29/58] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Apr 8 02:45:04 2022] POST /compute/v2.1/servers => generated 383 bytes in 2538 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 08 02:45:07.014656 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-ae40440a-7dd0-4c17-aa74-1af163665294 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:07.015363 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-ae40440a-7dd0-4c17-aa74-1af163665294 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:07.027305 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-1d685fa9-a388-4fad-9354-24cb3936a5d3 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:07.028194 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-1d685fa9-a388-4fad-9354-24cb3936a5d3 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 6228b11f-244d-4e25-8b1f-e19a90cc8c20] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:07.038449 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ae40440a-7dd0-4c17-aa74-1af163665294 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:07.038928 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ae40440a-7dd0-4c17-aa74-1af163665294 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:07.039706 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ae40440a-7dd0-4c17-aa74-1af163665294 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:07.040133 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ae40440a-7dd0-4c17-aa74-1af163665294 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:07.166145 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-1d685fa9-a388-4fad-9354-24cb3936a5d3 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:07.199746 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-1d685fa9-a388-4fad-9354-24cb3936a5d3 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20" status: 200 len: 1221 microversion: 2.1 time: 0.183955 Apr 08 02:45:07.212394 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 30/59] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:07 2022] GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20 => generated 1221 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:07.558488 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-ae40440a-7dd0-4c17-aa74-1af163665294 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:07.595481 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-ae40440a-7dd0-4c17-aa74-1af163665294 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:07.617729 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-ae40440a-7dd0-4c17-aa74-1af163665294 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:07.637594 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-ae40440a-7dd0-4c17-aa74-1af163665294 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1407 microversion: 2.20 time: 0.642138 Apr 08 02:45:07.637594 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 30/60] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:45:06 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1407 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:45:08.010156 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-e4058dca-2baa-40bc-9b29-d290ed896dad tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:08.011301 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-e4058dca-2baa-40bc-9b29-d290ed896dad tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] [instance: 2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:08.024050 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-e4058dca-2baa-40bc-9b29-d290ed896dad tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:08.024826 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-e4058dca-2baa-40bc-9b29-d290ed896dad tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:08.026947 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-e4058dca-2baa-40bc-9b29-d290ed896dad tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:08.027724 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-e4058dca-2baa-40bc-9b29-d290ed896dad tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:08.231445 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-abf4080e-c300-46bb-998f-83a6abff1a8c tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:08.232568 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-abf4080e-c300-46bb-998f-83a6abff1a8c tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 6228b11f-244d-4e25-8b1f-e19a90cc8c20] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:08.258252 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-abf4080e-c300-46bb-998f-83a6abff1a8c tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:08.258857 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-abf4080e-c300-46bb-998f-83a6abff1a8c tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:08.259677 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-abf4080e-c300-46bb-998f-83a6abff1a8c tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:08.265418 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-abf4080e-c300-46bb-998f-83a6abff1a8c tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:08.843367 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-abf4080e-c300-46bb-998f-83a6abff1a8c tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:08.868155 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-abf4080e-c300-46bb-998f-83a6abff1a8c tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20" status: 200 len: 1273 microversion: 2.1 time: 0.652905 Apr 08 02:45:08.871332 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 31/61] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:08 2022] GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20 => generated 1273 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:45:08.918131 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-db75b5a4-7e00-40ea-8458-428468629acc tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:08.920777 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-db75b5a4-7e00-40ea-8458-428468629acc tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:08.970735 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-db75b5a4-7e00-40ea-8458-428468629acc tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:08.974123 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-db75b5a4-7e00-40ea-8458-428468629acc tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:08.979707 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-db75b5a4-7e00-40ea-8458-428468629acc tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:08.982566 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-db75b5a4-7e00-40ea-8458-428468629acc tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:09.480720 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-e4058dca-2baa-40bc-9b29-d290ed896dad tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246bad06441497e9fd542cc1c84da0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ab2bde6dca4830a67ca00d0223b3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:09.498795 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-e4058dca-2baa-40bc-9b29-d290ed896dad tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] 10.222.0.48 "GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9" status: 200 len: 1315 microversion: 2.1 time: 1.506122 Apr 08 02:45:09.508850 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 31/62] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:07 2022] GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9 => generated 1315 bytes in 1518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:09.712429 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-db75b5a4-7e00-40ea-8458-428468629acc tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:09.744823 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-db75b5a4-7e00-40ea-8458-428468629acc tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:09.761557 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-db75b5a4-7e00-40ea-8458-428468629acc tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:09.764857 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-db75b5a4-7e00-40ea-8458-428468629acc tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1407 microversion: 2.20 time: 0.890285 Apr 08 02:45:09.767334 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 32/63] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:45:08 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1407 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:45:09.782098 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [req-c1cc28b1-4f42-445f-bdb0-e53278d07964 req-199064dc-aad2-4ab1-aa96-d221eef44fad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9", "name": "network-vif-plugged", "status": "completed", "tag": "44289cfd-1a39-4ed4-8b1c-43f7bf303706"}]} {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:45:09.795655 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:45:09.795655 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: warnings.warn(msg) Apr 08 02:45:09.817696 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-c1cc28b1-4f42-445f-bdb0-e53278d07964 req-199064dc-aad2-4ab1-aa96-d221eef44fad service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:09.818321 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-c1cc28b1-4f42-445f-bdb0-e53278d07964 req-199064dc-aad2-4ab1-aa96-d221eef44fad service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:09.859370 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.compute.server_external_events [req-c1cc28b1-4f42-445f-bdb0-e53278d07964 req-199064dc-aad2-4ab1-aa96-d221eef44fad service nova] Creating event network-vif-plugged:44289cfd-1a39-4ed4-8b1c-43f7bf303706 for instance 2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9 on hv-cinder-83705 Apr 08 02:45:09.861334 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-c1cc28b1-4f42-445f-bdb0-e53278d07964 req-199064dc-aad2-4ab1-aa96-d221eef44fad service nova] Acquired lock "compute-rpcapi-router" {{(pid=96920) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Apr 08 02:45:09.862787 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-42c0d854-0721-46ab-87cf-47e7838f2813 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:09.863665 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-42c0d854-0721-46ab-87cf-47e7838f2813 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:09.867636 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-42c0d854-0721-46ab-87cf-47e7838f2813 None None] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:09.868131 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-42c0d854-0721-46ab-87cf-47e7838f2813 None None] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:09.883522 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.compute.rpcapi [None req-42c0d854-0721-46ab-87cf-47e7838f2813 None None] Automatically selected compute RPC version 5.12 from minimum service version 53 Apr 08 02:45:09.884665 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-42c0d854-0721-46ab-87cf-47e7838f2813 None None] Releasing lock "compute-rpcapi-router" {{(pid=96920) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Apr 08 02:45:09.898754 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-d33656f2-2972-4f23-ae17-a975af86f2a4 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:09.900512 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-d33656f2-2972-4f23-ae17-a975af86f2a4 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 6228b11f-244d-4e25-8b1f-e19a90cc8c20] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:09.919661 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-d33656f2-2972-4f23-ae17-a975af86f2a4 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:09.922036 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-d33656f2-2972-4f23-ae17-a975af86f2a4 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:09.924856 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-d33656f2-2972-4f23-ae17-a975af86f2a4 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:09.925770 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-d33656f2-2972-4f23-ae17-a975af86f2a4 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:09.969068 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-42c0d854-0721-46ab-87cf-47e7838f2813 None None] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.312862 Apr 08 02:45:09.979956 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 32/64] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:45:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 02:45:10.023864 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [req-76eed6a5-ba6a-4803-849d-16eb7dc91d11 req-5bab96af-6388-4b59-aca2-1a923198ad59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e44bc1d2-0741-4081-9165-b0aca9008eaf", "tag": "e1447a33-5dc8-44ca-8978-a2f1cdaaab34"}]} {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:45:10.050157 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:45:10.050157 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: warnings.warn(msg) Apr 08 02:45:10.080347 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-76eed6a5-ba6a-4803-849d-16eb7dc91d11 req-5bab96af-6388-4b59-aca2-1a923198ad59 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:10.081777 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-76eed6a5-ba6a-4803-849d-16eb7dc91d11 req-5bab96af-6388-4b59-aca2-1a923198ad59 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:10.148779 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.compute.server_external_events [req-76eed6a5-ba6a-4803-849d-16eb7dc91d11 req-5bab96af-6388-4b59-aca2-1a923198ad59 service nova] Creating event network-changed:e1447a33-5dc8-44ca-8978-a2f1cdaaab34 for instance e44bc1d2-0741-4081-9165-b0aca9008eaf on hv-cinder-83705 Apr 08 02:45:10.162351 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [req-76eed6a5-ba6a-4803-849d-16eb7dc91d11 req-5bab96af-6388-4b59-aca2-1a923198ad59 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.176383 Apr 08 02:45:10.168945 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 33/65] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:45:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:45:10.446039 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-d33656f2-2972-4f23-ae17-a975af86f2a4 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:10.468424 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-d33656f2-2972-4f23-ae17-a975af86f2a4 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20" status: 200 len: 1279 microversion: 2.1 time: 0.586454 Apr 08 02:45:10.469496 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 33/66] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:09 2022] GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20 => generated 1279 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:10.534979 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-7bd13e45-ffd0-4bb7-84cd-1e213a8b94f8 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:10.536697 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-7bd13e45-ffd0-4bb7-84cd-1e213a8b94f8 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] [instance: 2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:10.550429 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-7bd13e45-ffd0-4bb7-84cd-1e213a8b94f8 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:10.551449 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-7bd13e45-ffd0-4bb7-84cd-1e213a8b94f8 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:10.553160 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-7bd13e45-ffd0-4bb7-84cd-1e213a8b94f8 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:10.555451 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-7bd13e45-ffd0-4bb7-84cd-1e213a8b94f8 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:10.790816 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-a434a4dd-7953-452a-b4d5-88a1eba1056b tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:10.792137 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-a434a4dd-7953-452a-b4d5-88a1eba1056b tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:10.800688 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-a434a4dd-7953-452a-b4d5-88a1eba1056b tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:10.802177 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-a434a4dd-7953-452a-b4d5-88a1eba1056b tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:10.803196 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-a434a4dd-7953-452a-b4d5-88a1eba1056b tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:10.803906 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-a434a4dd-7953-452a-b4d5-88a1eba1056b tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:11.266808 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-7bd13e45-ffd0-4bb7-84cd-1e213a8b94f8 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246bad06441497e9fd542cc1c84da0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ab2bde6dca4830a67ca00d0223b3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:11.277793 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-7bd13e45-ffd0-4bb7-84cd-1e213a8b94f8 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] 10.222.0.48 "GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9" status: 200 len: 1315 microversion: 2.1 time: 0.764974 Apr 08 02:45:11.294076 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 34/67] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:10 2022] GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9 => generated 1315 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:11.416348 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-a434a4dd-7953-452a-b4d5-88a1eba1056b tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:11.452567 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-a434a4dd-7953-452a-b4d5-88a1eba1056b tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:11.468735 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-a434a4dd-7953-452a-b4d5-88a1eba1056b tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:11.469734 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-a434a4dd-7953-452a-b4d5-88a1eba1056b tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1407 microversion: 2.20 time: 0.688303 Apr 08 02:45:11.470294 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 34/68] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:45:10 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1407 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 02:45:11.492198 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-27c79e23-00b6-4004-ab90-c1fb67427a1f tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:11.492802 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-27c79e23-00b6-4004-ab90-c1fb67427a1f tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 6228b11f-244d-4e25-8b1f-e19a90cc8c20] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:11.503241 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-27c79e23-00b6-4004-ab90-c1fb67427a1f tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:11.504105 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-27c79e23-00b6-4004-ab90-c1fb67427a1f tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:11.505379 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-27c79e23-00b6-4004-ab90-c1fb67427a1f tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:11.506177 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-27c79e23-00b6-4004-ab90-c1fb67427a1f tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:11.522367 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [req-a3e06e05-da1c-4f07-8006-9eb4178b1c95 req-34e1a2db-b63e-4337-85bd-0701041295cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe2c4fd0-315a-4d94-8913-a661cdfa293a", "tag": "1765d10f-4f9f-4883-99d5-299517e80053"}]} {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:45:11.537979 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:45:11.537979 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: warnings.warn(msg) Apr 08 02:45:11.575184 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-a3e06e05-da1c-4f07-8006-9eb4178b1c95 req-34e1a2db-b63e-4337-85bd-0701041295cd service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:11.575819 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-a3e06e05-da1c-4f07-8006-9eb4178b1c95 req-34e1a2db-b63e-4337-85bd-0701041295cd service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:11.616751 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.compute.server_external_events [req-a3e06e05-da1c-4f07-8006-9eb4178b1c95 req-34e1a2db-b63e-4337-85bd-0701041295cd service nova] Creating event network-changed:1765d10f-4f9f-4883-99d5-299517e80053 for instance fe2c4fd0-315a-4d94-8913-a661cdfa293a on hv-cinder-83705 Apr 08 02:45:11.622487 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [req-a3e06e05-da1c-4f07-8006-9eb4178b1c95 req-34e1a2db-b63e-4337-85bd-0701041295cd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.257133 Apr 08 02:45:11.623848 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 35/69] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:45:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:45:11.786688 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-27c79e23-00b6-4004-ab90-c1fb67427a1f tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:11.796430 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-27c79e23-00b6-4004-ab90-c1fb67427a1f tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20" status: 200 len: 1321 microversion: 2.1 time: 0.314301 Apr 08 02:45:11.797527 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 35/70] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:11 2022] GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20 => generated 1321 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:45:12.328075 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-f8157ef5-559b-47b4-bcbb-0c94b9fa7e29 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:12.332375 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-f8157ef5-559b-47b4-bcbb-0c94b9fa7e29 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] [instance: 2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:12.365700 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-f8157ef5-559b-47b4-bcbb-0c94b9fa7e29 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:12.366265 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-f8157ef5-559b-47b4-bcbb-0c94b9fa7e29 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:12.367104 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-f8157ef5-559b-47b4-bcbb-0c94b9fa7e29 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:12.367600 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-f8157ef5-559b-47b4-bcbb-0c94b9fa7e29 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:12.494068 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-b3e7a603-9615-4331-9546-d7f82f682a94 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:12.495269 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-b3e7a603-9615-4331-9546-d7f82f682a94 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:12.532331 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b3e7a603-9615-4331-9546-d7f82f682a94 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:12.532783 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b3e7a603-9615-4331-9546-d7f82f682a94 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:12.533585 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b3e7a603-9615-4331-9546-d7f82f682a94 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:12.534015 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b3e7a603-9615-4331-9546-d7f82f682a94 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:12.727806 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-f8157ef5-559b-47b4-bcbb-0c94b9fa7e29 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246bad06441497e9fd542cc1c84da0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ab2bde6dca4830a67ca00d0223b3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:12.744669 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-f8157ef5-559b-47b4-bcbb-0c94b9fa7e29 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] 10.222.0.48 "GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9" status: 200 len: 1315 microversion: 2.1 time: 0.436821 Apr 08 02:45:12.748110 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 36/71] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:12 2022] GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9 => generated 1315 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:12.758826 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-37e2e26d-2e66-4834-bd31-66205ee71882 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2141362906", "imageRef": "7f8ca061-f382-4052-8d05-69f37e107684", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8b5bf61a-9182-47e6-a758-1a71619fdd20"}], "security_groups": [{"name": "tempest-securitygroup--127703240"}], "key_name": "tempest-keypair-89554807", "user_data": "}} {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:45:12.909530 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-b3e7a603-9615-4331-9546-d7f82f682a94 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:12.950066 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-b3e7a603-9615-4331-9546-d7f82f682a94 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:12.958214 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-b3e7a603-9615-4331-9546-d7f82f682a94 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:12.959509 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-b3e7a603-9615-4331-9546-d7f82f682a94 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1407 microversion: 2.20 time: 0.475777 Apr 08 02:45:12.960388 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 36/72] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:45:12 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1407 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:45:12.972747 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-3cc49afb-e9a6-4e74-8619-8b4134a8944f tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:12.973586 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-3cc49afb-e9a6-4e74-8619-8b4134a8944f tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 6228b11f-244d-4e25-8b1f-e19a90cc8c20] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:12.984364 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-3cc49afb-e9a6-4e74-8619-8b4134a8944f tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:12.984809 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-3cc49afb-e9a6-4e74-8619-8b4134a8944f tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:12.985929 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-3cc49afb-e9a6-4e74-8619-8b4134a8944f tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:12.986531 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-3cc49afb-e9a6-4e74-8619-8b4134a8944f tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:13.007558 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.network.neutron [None req-37e2e26d-2e66-4834-bd31-66205ee71882 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] validate_networks() for [('8b5bf61a-9182-47e6-a758-1a71619fdd20', None, None, None)] {{(pid=96920) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} Apr 08 02:45:13.382002 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-3cc49afb-e9a6-4e74-8619-8b4134a8944f tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:13.400135 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-3cc49afb-e9a6-4e74-8619-8b4134a8944f tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20" status: 200 len: 1321 microversion: 2.1 time: 0.438607 Apr 08 02:45:13.404224 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 37/73] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:12 2022] GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20 => generated 1321 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:13.739521 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.virt.hardware [None req-37e2e26d-2e66-4834-bd31-66205ee71882 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Flavor limits 0:0:0 {{(pid=96920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} Apr 08 02:45:13.740042 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.virt.hardware [None req-37e2e26d-2e66-4834-bd31-66205ee71882 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Image limits 0:0:0 {{(pid=96920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} Apr 08 02:45:13.740517 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.virt.hardware [None req-37e2e26d-2e66-4834-bd31-66205ee71882 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Flavor pref 0:0:0 {{(pid=96920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} Apr 08 02:45:13.740926 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.virt.hardware [None req-37e2e26d-2e66-4834-bd31-66205ee71882 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Image pref 0:0:0 {{(pid=96920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} Apr 08 02:45:13.741335 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.virt.hardware [None req-37e2e26d-2e66-4834-bd31-66205ee71882 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=96920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} Apr 08 02:45:13.750634 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-37e2e26d-2e66-4834-bd31-66205ee71882 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:13.751108 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-37e2e26d-2e66-4834-bd31-66205ee71882 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:13.751903 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-37e2e26d-2e66-4834-bd31-66205ee71882 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:13.752331 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-37e2e26d-2e66-4834-bd31-66205ee71882 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:13.769699 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-1d7c6783-4aec-4434-9104-b75aebebe74b tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:13.770900 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-1d7c6783-4aec-4434-9104-b75aebebe74b tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] [instance: 2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:13.773914 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.quota [None req-37e2e26d-2e66-4834-bd31-66205ee71882 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Getting quotas for project cbbf5bb7e51d4d2d8594d6d1d3a797a3. Resources: {'instances', 'cores', 'ram'} {{(pid=96920) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:45:13.778456 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-1d7c6783-4aec-4434-9104-b75aebebe74b tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:13.778746 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.quota [None req-37e2e26d-2e66-4834-bd31-66205ee71882 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Getting quotas for user b68bc45984974d6da1c9151c21dae14c and project cbbf5bb7e51d4d2d8594d6d1d3a797a3. Resources: {'instances', 'cores', 'ram'} {{(pid=96920) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:45:13.779399 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-1d7c6783-4aec-4434-9104-b75aebebe74b tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:13.780380 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-1d7c6783-4aec-4434-9104-b75aebebe74b tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:13.781371 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-1d7c6783-4aec-4434-9104-b75aebebe74b tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:13.793291 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-37e2e26d-2e66-4834-bd31-66205ee71882 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Going to run 1 instances... {{(pid=96920) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} Apr 08 02:45:13.796226 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-37e2e26d-2e66-4834-bd31-66205ee71882 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 09e6abc6-19f4-4355-8309-fb3279d9b5e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7f8ca061-f382-4052-8d05-69f37e107684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=96920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} Apr 08 02:45:13.861061 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-37e2e26d-2e66-4834-bd31-66205ee71882 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.111598 Apr 08 02:45:13.862052 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 37/74] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Apr 8 02:45:12 2022] POST /compute/v2.1/servers => generated 401 bytes in 1113 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 08 02:45:13.877474 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-b750323e-afaa-424b-b2bc-1376e95c3ff0 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:13.878079 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-b750323e-afaa-424b-b2bc-1376e95c3ff0 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 09e6abc6-19f4-4355-8309-fb3279d9b5e3] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:14.003953 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-b750323e-afaa-424b-b2bc-1376e95c3ff0 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68bc45984974d6da1c9151c21dae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbf5bb7e51d4d2d8594d6d1d3a797a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:14.022538 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-b750323e-afaa-424b-b2bc-1376e95c3ff0 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3" status: 200 len: 1240 microversion: 2.1 time: 0.153857 Apr 08 02:45:14.023175 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 38/75] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:13 2022] GET /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3 => generated 1240 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:14.082154 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-fedf8078-46ca-4264-8b47-4e5a13841183 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:14.083020 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-fedf8078-46ca-4264-8b47-4e5a13841183 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:14.109085 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-fedf8078-46ca-4264-8b47-4e5a13841183 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:14.109570 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-fedf8078-46ca-4264-8b47-4e5a13841183 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:14.110457 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-fedf8078-46ca-4264-8b47-4e5a13841183 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:14.110879 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-fedf8078-46ca-4264-8b47-4e5a13841183 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:14.176492 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-1d7c6783-4aec-4434-9104-b75aebebe74b tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246bad06441497e9fd542cc1c84da0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ab2bde6dca4830a67ca00d0223b3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:14.200471 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-1d7c6783-4aec-4434-9104-b75aebebe74b tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] 10.222.0.48 "GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9" status: 200 len: 1315 microversion: 2.1 time: 0.439010 Apr 08 02:45:14.203217 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 38/76] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:13 2022] GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9 => generated 1315 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:45:14.429296 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-856c8bfd-8a2f-4026-82cd-0868c9c58ebb tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:14.431472 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-856c8bfd-8a2f-4026-82cd-0868c9c58ebb tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 6228b11f-244d-4e25-8b1f-e19a90cc8c20] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:14.447665 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-856c8bfd-8a2f-4026-82cd-0868c9c58ebb tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:14.449280 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-856c8bfd-8a2f-4026-82cd-0868c9c58ebb tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:14.450952 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-856c8bfd-8a2f-4026-82cd-0868c9c58ebb tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:14.453016 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-856c8bfd-8a2f-4026-82cd-0868c9c58ebb tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:15.146460 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-fedf8078-46ca-4264-8b47-4e5a13841183 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:15.177951 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-fedf8078-46ca-4264-8b47-4e5a13841183 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:15.194225 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-fedf8078-46ca-4264-8b47-4e5a13841183 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:15.197895 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-fedf8078-46ca-4264-8b47-4e5a13841183 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1407 microversion: 2.20 time: 1.162084 Apr 08 02:45:15.210514 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 39/77] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:45:14 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1407 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:45:15.227711 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-c1370c7a-ea4f-4e94-a385-00adfb341755 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:15.228536 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-c1370c7a-ea4f-4e94-a385-00adfb341755 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 09e6abc6-19f4-4355-8309-fb3279d9b5e3] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:15.237723 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c1370c7a-ea4f-4e94-a385-00adfb341755 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:15.238350 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c1370c7a-ea4f-4e94-a385-00adfb341755 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:15.240210 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c1370c7a-ea4f-4e94-a385-00adfb341755 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:15.241347 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c1370c7a-ea4f-4e94-a385-00adfb341755 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:15.374562 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-856c8bfd-8a2f-4026-82cd-0868c9c58ebb tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:15.390566 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-856c8bfd-8a2f-4026-82cd-0868c9c58ebb tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20" status: 200 len: 1321 microversion: 2.1 time: 0.972258 Apr 08 02:45:15.392468 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 39/78] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:14 2022] GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20 => generated 1321 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:15.403888 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-19cb7096-e32a-4763-9f93-850630d6ac88 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:15.404751 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-19cb7096-e32a-4763-9f93-850630d6ac88 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] [instance: 2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:15.414802 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-19cb7096-e32a-4763-9f93-850630d6ac88 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:15.415460 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-19cb7096-e32a-4763-9f93-850630d6ac88 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:15.416531 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-19cb7096-e32a-4763-9f93-850630d6ac88 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:15.416970 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-19cb7096-e32a-4763-9f93-850630d6ac88 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:15.526312 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-c1370c7a-ea4f-4e94-a385-00adfb341755 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68bc45984974d6da1c9151c21dae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbf5bb7e51d4d2d8594d6d1d3a797a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:15.539286 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-c1370c7a-ea4f-4e94-a385-00adfb341755 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3" status: 200 len: 1292 microversion: 2.1 time: 0.327267 Apr 08 02:45:15.543080 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 40/79] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:15 2022] GET /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3 => generated 1292 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:15.927667 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-19cb7096-e32a-4763-9f93-850630d6ac88 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246bad06441497e9fd542cc1c84da0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ab2bde6dca4830a67ca00d0223b3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:15.937809 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-19cb7096-e32a-4763-9f93-850630d6ac88 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] 10.222.0.48 "GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9" status: 200 len: 1315 microversion: 2.1 time: 0.543850 Apr 08 02:45:15.938372 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 40/80] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:15 2022] GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9 => generated 1315 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:16.221537 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-e35f09ee-7e0e-4b30-8b58-93811620cf43 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:16.222245 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-e35f09ee-7e0e-4b30-8b58-93811620cf43 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:16.238401 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-e35f09ee-7e0e-4b30-8b58-93811620cf43 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:16.238917 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-e35f09ee-7e0e-4b30-8b58-93811620cf43 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:16.239726 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-e35f09ee-7e0e-4b30-8b58-93811620cf43 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:16.244092 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-e35f09ee-7e0e-4b30-8b58-93811620cf43 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:16.415519 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-e5bcc788-1954-4512-b688-40e03025794d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:16.416128 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-e5bcc788-1954-4512-b688-40e03025794d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 6228b11f-244d-4e25-8b1f-e19a90cc8c20] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:16.440180 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-e5bcc788-1954-4512-b688-40e03025794d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:16.440635 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-e5bcc788-1954-4512-b688-40e03025794d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:16.441421 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-e5bcc788-1954-4512-b688-40e03025794d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:16.442371 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-e5bcc788-1954-4512-b688-40e03025794d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:16.776224 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-e35f09ee-7e0e-4b30-8b58-93811620cf43 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:16.813898 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-e35f09ee-7e0e-4b30-8b58-93811620cf43 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:16.836865 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-e35f09ee-7e0e-4b30-8b58-93811620cf43 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:16.841399 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-e35f09ee-7e0e-4b30-8b58-93811620cf43 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1407 microversion: 2.20 time: 0.629030 Apr 08 02:45:16.844816 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 41/81] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:45:16 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1407 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:45:16.872781 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-78efd8c9-2017-43c0-9cb0-66c3978ce4ba tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:16.893824 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-78efd8c9-2017-43c0-9cb0-66c3978ce4ba tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 09e6abc6-19f4-4355-8309-fb3279d9b5e3] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:16.924574 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-78efd8c9-2017-43c0-9cb0-66c3978ce4ba tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:16.927228 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-78efd8c9-2017-43c0-9cb0-66c3978ce4ba tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:16.933956 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-78efd8c9-2017-43c0-9cb0-66c3978ce4ba tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:16.937961 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-78efd8c9-2017-43c0-9cb0-66c3978ce4ba tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:16.959183 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-e5bcc788-1954-4512-b688-40e03025794d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:16.968587 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-e5bcc788-1954-4512-b688-40e03025794d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20" status: 200 len: 1321 microversion: 2.1 time: 0.563236 Apr 08 02:45:16.983040 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 41/82] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:16 2022] GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20 => generated 1321 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:45:16.993798 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [req-3a54b40a-99e8-4380-acf8-5aba3e955fb2 req-2af4f4f0-49b5-4ab9-bc62-dc2f2acb9768 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6228b11f-244d-4e25-8b1f-e19a90cc8c20", "tag": "8cf7f363-1f61-4342-8249-2e47822bc532"}]} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:45:17.000427 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:45:17.000427 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: warnings.warn(msg) Apr 08 02:45:17.029939 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-3a54b40a-99e8-4380-acf8-5aba3e955fb2 req-2af4f4f0-49b5-4ab9-bc62-dc2f2acb9768 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:17.031563 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-3a54b40a-99e8-4380-acf8-5aba3e955fb2 req-2af4f4f0-49b5-4ab9-bc62-dc2f2acb9768 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:17.061978 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.compute.server_external_events [req-3a54b40a-99e8-4380-acf8-5aba3e955fb2 req-2af4f4f0-49b5-4ab9-bc62-dc2f2acb9768 service nova] Creating event network-changed:8cf7f363-1f61-4342-8249-2e47822bc532 for instance 6228b11f-244d-4e25-8b1f-e19a90cc8c20 on hv-cinder-83705 Apr 08 02:45:17.069456 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [req-3a54b40a-99e8-4380-acf8-5aba3e955fb2 req-2af4f4f0-49b5-4ab9-bc62-dc2f2acb9768 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084902 Apr 08 02:45:17.071991 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 42/83] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:45:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:45:17.102462 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-7ae00bcc-2899-4f75-a14a-b241e5730cff tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:17.127419 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-7ae00bcc-2899-4f75-a14a-b241e5730cff tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] [instance: 2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:17.144934 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-7ae00bcc-2899-4f75-a14a-b241e5730cff tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:17.145390 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-7ae00bcc-2899-4f75-a14a-b241e5730cff tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:17.146168 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-7ae00bcc-2899-4f75-a14a-b241e5730cff tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:17.146598 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-7ae00bcc-2899-4f75-a14a-b241e5730cff tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:17.189076 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-78efd8c9-2017-43c0-9cb0-66c3978ce4ba tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68bc45984974d6da1c9151c21dae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbf5bb7e51d4d2d8594d6d1d3a797a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:17.199517 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-78efd8c9-2017-43c0-9cb0-66c3978ce4ba tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3" status: 200 len: 1292 microversion: 2.1 time: 0.352186 Apr 08 02:45:17.200235 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 42/84] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:16 2022] GET /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3 => generated 1292 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:17.475393 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-7ae00bcc-2899-4f75-a14a-b241e5730cff tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246bad06441497e9fd542cc1c84da0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ab2bde6dca4830a67ca00d0223b3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:17.485381 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-7ae00bcc-2899-4f75-a14a-b241e5730cff tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] 10.222.0.48 "GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9" status: 200 len: 1315 microversion: 2.1 time: 0.407494 Apr 08 02:45:17.486239 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 43/85] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:17 2022] GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9 => generated 1315 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:17.867268 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-89aa8ca1-edfe-4b5a-b74f-ac2315353030 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:17.867844 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-89aa8ca1-edfe-4b5a-b74f-ac2315353030 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:17.875136 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-89aa8ca1-edfe-4b5a-b74f-ac2315353030 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:17.875578 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-89aa8ca1-edfe-4b5a-b74f-ac2315353030 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:17.876513 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-89aa8ca1-edfe-4b5a-b74f-ac2315353030 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:17.877095 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-89aa8ca1-edfe-4b5a-b74f-ac2315353030 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:17.993287 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-03f9caf7-4d48-456a-85b0-db5f45e79736 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:17.993902 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-03f9caf7-4d48-456a-85b0-db5f45e79736 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 6228b11f-244d-4e25-8b1f-e19a90cc8c20] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:18.001627 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-03f9caf7-4d48-456a-85b0-db5f45e79736 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:18.002432 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-03f9caf7-4d48-456a-85b0-db5f45e79736 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:18.004559 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-03f9caf7-4d48-456a-85b0-db5f45e79736 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:18.005234 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-03f9caf7-4d48-456a-85b0-db5f45e79736 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:18.207948 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-89aa8ca1-edfe-4b5a-b74f-ac2315353030 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:18.230396 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-89aa8ca1-edfe-4b5a-b74f-ac2315353030 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:18.237452 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-89aa8ca1-edfe-4b5a-b74f-ac2315353030 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:18.239332 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-89aa8ca1-edfe-4b5a-b74f-ac2315353030 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1407 microversion: 2.20 time: 0.381306 Apr 08 02:45:18.249577 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 43/86] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:45:17 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1407 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:45:18.250525 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-de458187-225d-466c-8eda-a7a6f61e9437 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:18.251187 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-de458187-225d-466c-8eda-a7a6f61e9437 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 09e6abc6-19f4-4355-8309-fb3279d9b5e3] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:18.259706 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-de458187-225d-466c-8eda-a7a6f61e9437 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:18.260159 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-de458187-225d-466c-8eda-a7a6f61e9437 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:18.260935 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-de458187-225d-466c-8eda-a7a6f61e9437 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:18.261566 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-de458187-225d-466c-8eda-a7a6f61e9437 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:18.309656 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-03f9caf7-4d48-456a-85b0-db5f45e79736 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:18.322915 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-03f9caf7-4d48-456a-85b0-db5f45e79736 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20" status: 200 len: 1321 microversion: 2.1 time: 0.341210 Apr 08 02:45:18.323786 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 44/87] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:17 2022] GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20 => generated 1321 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:18.435948 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-de458187-225d-466c-8eda-a7a6f61e9437 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68bc45984974d6da1c9151c21dae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbf5bb7e51d4d2d8594d6d1d3a797a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:18.453970 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-de458187-225d-466c-8eda-a7a6f61e9437 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3" status: 200 len: 1292 microversion: 2.1 time: 0.212506 Apr 08 02:45:18.454701 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 44/88] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:18 2022] GET /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3 => generated 1292 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:18.508825 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-4d786699-ba30-4ed1-a127-4d80cf920a92 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:18.509537 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-4d786699-ba30-4ed1-a127-4d80cf920a92 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] [instance: 2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:18.517253 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-4d786699-ba30-4ed1-a127-4d80cf920a92 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:18.517798 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-4d786699-ba30-4ed1-a127-4d80cf920a92 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:18.518794 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-4d786699-ba30-4ed1-a127-4d80cf920a92 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:18.519224 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-4d786699-ba30-4ed1-a127-4d80cf920a92 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:18.730805 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-4d786699-ba30-4ed1-a127-4d80cf920a92 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246bad06441497e9fd542cc1c84da0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ab2bde6dca4830a67ca00d0223b3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:18.739053 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-4d786699-ba30-4ed1-a127-4d80cf920a92 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] 10.222.0.48 "GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9" status: 200 len: 1315 microversion: 2.1 time: 0.239525 Apr 08 02:45:18.739705 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 45/89] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:18 2022] GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9 => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:19.278315 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-02929121-3f5e-4b2d-bc7e-16235cdf0158 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:19.278981 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-02929121-3f5e-4b2d-bc7e-16235cdf0158 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:19.298539 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-02929121-3f5e-4b2d-bc7e-16235cdf0158 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:19.299015 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-02929121-3f5e-4b2d-bc7e-16235cdf0158 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:19.299808 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-02929121-3f5e-4b2d-bc7e-16235cdf0158 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:19.303829 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-02929121-3f5e-4b2d-bc7e-16235cdf0158 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:19.349019 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-2beaa1aa-bf3f-41f7-9d5e-9b689f807de2 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:19.349613 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-2beaa1aa-bf3f-41f7-9d5e-9b689f807de2 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 6228b11f-244d-4e25-8b1f-e19a90cc8c20] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:19.358616 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-2beaa1aa-bf3f-41f7-9d5e-9b689f807de2 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:19.359074 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-2beaa1aa-bf3f-41f7-9d5e-9b689f807de2 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:19.359940 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-2beaa1aa-bf3f-41f7-9d5e-9b689f807de2 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:19.362737 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-2beaa1aa-bf3f-41f7-9d5e-9b689f807de2 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:19.638901 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-02929121-3f5e-4b2d-bc7e-16235cdf0158 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:19.641433 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-2beaa1aa-bf3f-41f7-9d5e-9b689f807de2 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:19.649355 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-2beaa1aa-bf3f-41f7-9d5e-9b689f807de2 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20" status: 200 len: 1321 microversion: 2.1 time: 0.313372 Apr 08 02:45:19.649880 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 46/90] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:19 2022] GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20 => generated 1321 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:45:19.657949 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-02929121-3f5e-4b2d-bc7e-16235cdf0158 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:19.659271 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-b0cd4066-58d3-43a3-a7b4-f5b127c94545 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:19.659861 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-b0cd4066-58d3-43a3-a7b4-f5b127c94545 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 09e6abc6-19f4-4355-8309-fb3279d9b5e3] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:19.664787 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-02929121-3f5e-4b2d-bc7e-16235cdf0158 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:19.665837 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-02929121-3f5e-4b2d-bc7e-16235cdf0158 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1407 microversion: 2.20 time: 0.412525 Apr 08 02:45:19.666357 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 45/91] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:45:19 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1407 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:45:19.666684 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b0cd4066-58d3-43a3-a7b4-f5b127c94545 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:19.667145 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b0cd4066-58d3-43a3-a7b4-f5b127c94545 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:19.667905 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b0cd4066-58d3-43a3-a7b4-f5b127c94545 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:19.668331 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b0cd4066-58d3-43a3-a7b4-f5b127c94545 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:19.761659 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-0d7fb681-4351-4618-b9b0-acb1f257c970 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:19.762176 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-0d7fb681-4351-4618-b9b0-acb1f257c970 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] [instance: 2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:19.772272 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-0d7fb681-4351-4618-b9b0-acb1f257c970 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:19.772723 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-0d7fb681-4351-4618-b9b0-acb1f257c970 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:19.773500 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-0d7fb681-4351-4618-b9b0-acb1f257c970 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:19.773929 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-0d7fb681-4351-4618-b9b0-acb1f257c970 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:19.797917 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-b0cd4066-58d3-43a3-a7b4-f5b127c94545 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68bc45984974d6da1c9151c21dae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbf5bb7e51d4d2d8594d6d1d3a797a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:19.821987 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-b0cd4066-58d3-43a3-a7b4-f5b127c94545 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3" status: 200 len: 1292 microversion: 2.1 time: 0.171041 Apr 08 02:45:19.822560 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 47/92] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:19 2022] GET /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3 => generated 1292 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:20.186181 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-0d7fb681-4351-4618-b9b0-acb1f257c970 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246bad06441497e9fd542cc1c84da0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ab2bde6dca4830a67ca00d0223b3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:20.194540 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-0d7fb681-4351-4618-b9b0-acb1f257c970 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] 10.222.0.48 "GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9" status: 200 len: 1315 microversion: 2.1 time: 0.442395 Apr 08 02:45:20.195119 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 46/93] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:19 2022] GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9 => generated 1315 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:45:20.671686 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-71298d24-f449-499c-8c23-7c08e9a4bec8 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:20.672831 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-71298d24-f449-499c-8c23-7c08e9a4bec8 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 6228b11f-244d-4e25-8b1f-e19a90cc8c20] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:20.690142 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-e845769b-8f81-4663-9a9c-5759b11d1260 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:20.693099 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-e845769b-8f81-4663-9a9c-5759b11d1260 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:20.700310 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-71298d24-f449-499c-8c23-7c08e9a4bec8 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:20.701079 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-71298d24-f449-499c-8c23-7c08e9a4bec8 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:20.701400 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-e845769b-8f81-4663-9a9c-5759b11d1260 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:20.702050 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-71298d24-f449-499c-8c23-7c08e9a4bec8 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:20.702416 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-e845769b-8f81-4663-9a9c-5759b11d1260 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:20.702685 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-71298d24-f449-499c-8c23-7c08e9a4bec8 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:20.703390 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-e845769b-8f81-4663-9a9c-5759b11d1260 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:20.704078 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-e845769b-8f81-4663-9a9c-5759b11d1260 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:21.103087 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-e845769b-8f81-4663-9a9c-5759b11d1260 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:21.103895 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-71298d24-f449-499c-8c23-7c08e9a4bec8 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:21.112421 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-71298d24-f449-499c-8c23-7c08e9a4bec8 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20" status: 200 len: 1321 microversion: 2.1 time: 0.450088 Apr 08 02:45:21.121649 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-e845769b-8f81-4663-9a9c-5759b11d1260 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:21.124373 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 48/94] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:20 2022] GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20 => generated 1321 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:21.129009 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-e845769b-8f81-4663-9a9c-5759b11d1260 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:21.130431 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-e845769b-8f81-4663-9a9c-5759b11d1260 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1407 microversion: 2.20 time: 0.449408 Apr 08 02:45:21.134716 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 47/95] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:45:20 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1407 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:45:21.143129 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-b440e6e0-4958-4ceb-9ee3-8616a09df797 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:21.148646 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-b440e6e0-4958-4ceb-9ee3-8616a09df797 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 09e6abc6-19f4-4355-8309-fb3279d9b5e3] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:21.157531 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b440e6e0-4958-4ceb-9ee3-8616a09df797 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:21.158238 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b440e6e0-4958-4ceb-9ee3-8616a09df797 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:21.159240 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b440e6e0-4958-4ceb-9ee3-8616a09df797 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:21.160074 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b440e6e0-4958-4ceb-9ee3-8616a09df797 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:21.217132 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-239364c2-a8b4-4f5e-8ea0-7ca95e614f43 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:21.217738 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-239364c2-a8b4-4f5e-8ea0-7ca95e614f43 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] [instance: 2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:21.230954 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-239364c2-a8b4-4f5e-8ea0-7ca95e614f43 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:21.230954 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-239364c2-a8b4-4f5e-8ea0-7ca95e614f43 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:21.231236 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-239364c2-a8b4-4f5e-8ea0-7ca95e614f43 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:21.231571 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-239364c2-a8b4-4f5e-8ea0-7ca95e614f43 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:21.305259 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-b440e6e0-4958-4ceb-9ee3-8616a09df797 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68bc45984974d6da1c9151c21dae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbf5bb7e51d4d2d8594d6d1d3a797a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:21.313568 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-b440e6e0-4958-4ceb-9ee3-8616a09df797 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3" status: 200 len: 1298 microversion: 2.1 time: 0.187829 Apr 08 02:45:21.314106 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 49/96] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:21 2022] GET /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3 => generated 1298 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:21.457933 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-239364c2-a8b4-4f5e-8ea0-7ca95e614f43 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246bad06441497e9fd542cc1c84da0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ab2bde6dca4830a67ca00d0223b3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:21.467953 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-239364c2-a8b4-4f5e-8ea0-7ca95e614f43 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] 10.222.0.48 "GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9" status: 200 len: 1502 microversion: 2.1 time: 0.259626 Apr 08 02:45:21.468813 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 48/97] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:21 2022] GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9 => generated 1502 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:45:22.135935 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-b245dc24-f92d-4c2e-8382-1cc1adccac02 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:22.136470 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-b245dc24-f92d-4c2e-8382-1cc1adccac02 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 6228b11f-244d-4e25-8b1f-e19a90cc8c20] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:22.143921 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b245dc24-f92d-4c2e-8382-1cc1adccac02 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:22.144357 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b245dc24-f92d-4c2e-8382-1cc1adccac02 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:22.145159 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b245dc24-f92d-4c2e-8382-1cc1adccac02 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:22.145552 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b245dc24-f92d-4c2e-8382-1cc1adccac02 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:22.153158 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-835b7a28-074c-42d7-9fd3-c2373b31c371 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:22.153753 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-835b7a28-074c-42d7-9fd3-c2373b31c371 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:22.161472 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-835b7a28-074c-42d7-9fd3-c2373b31c371 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:22.161907 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-835b7a28-074c-42d7-9fd3-c2373b31c371 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:22.162658 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-835b7a28-074c-42d7-9fd3-c2373b31c371 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:22.163102 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-835b7a28-074c-42d7-9fd3-c2373b31c371 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:22.435370 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-835b7a28-074c-42d7-9fd3-c2373b31c371 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:22.438817 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-b245dc24-f92d-4c2e-8382-1cc1adccac02 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:22.447259 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-b245dc24-f92d-4c2e-8382-1cc1adccac02 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20" status: 200 len: 1321 microversion: 2.1 time: 0.321154 Apr 08 02:45:22.447907 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 50/98] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:22 2022] GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20 => generated 1321 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:22.452588 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-835b7a28-074c-42d7-9fd3-c2373b31c371 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:22.458213 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-d23e9a13-8187-4c6c-bf9b-eb5e8c7b4d74 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:22.458913 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-d23e9a13-8187-4c6c-bf9b-eb5e8c7b4d74 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 09e6abc6-19f4-4355-8309-fb3279d9b5e3] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:22.459365 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-835b7a28-074c-42d7-9fd3-c2373b31c371 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:22.460443 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-835b7a28-074c-42d7-9fd3-c2373b31c371 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1407 microversion: 2.20 time: 0.316435 Apr 08 02:45:22.460965 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 49/99] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:45:22 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1407 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 02:45:22.466467 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-d23e9a13-8187-4c6c-bf9b-eb5e8c7b4d74 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:22.467007 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-d23e9a13-8187-4c6c-bf9b-eb5e8c7b4d74 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:22.467933 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-d23e9a13-8187-4c6c-bf9b-eb5e8c7b4d74 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:22.468522 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-d23e9a13-8187-4c6c-bf9b-eb5e8c7b4d74 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:22.589135 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-d23e9a13-8187-4c6c-bf9b-eb5e8c7b4d74 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68bc45984974d6da1c9151c21dae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbf5bb7e51d4d2d8594d6d1d3a797a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:22.597359 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-d23e9a13-8187-4c6c-bf9b-eb5e8c7b4d74 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3" status: 200 len: 1298 microversion: 2.1 time: 0.148291 Apr 08 02:45:22.598572 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 51/100] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:22 2022] GET /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3 => generated 1298 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:23.469278 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-7b449a4c-1bba-4bc9-9f07-1100e8110232 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:23.469806 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-7b449a4c-1bba-4bc9-9f07-1100e8110232 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 6228b11f-244d-4e25-8b1f-e19a90cc8c20] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:23.478161 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-7b449a4c-1bba-4bc9-9f07-1100e8110232 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:23.478610 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-7b449a4c-1bba-4bc9-9f07-1100e8110232 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:23.479415 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-7b449a4c-1bba-4bc9-9f07-1100e8110232 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:23.479850 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-7b449a4c-1bba-4bc9-9f07-1100e8110232 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:23.488033 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-ea1fb89c-94c8-4044-9642-9b739a802b96 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:23.488743 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-ea1fb89c-94c8-4044-9642-9b739a802b96 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:23.496029 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ea1fb89c-94c8-4044-9642-9b739a802b96 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:23.496470 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ea1fb89c-94c8-4044-9642-9b739a802b96 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:23.497232 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ea1fb89c-94c8-4044-9642-9b739a802b96 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:23.497660 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ea1fb89c-94c8-4044-9642-9b739a802b96 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:23.788091 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-ea1fb89c-94c8-4044-9642-9b739a802b96 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:23.790125 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-7b449a4c-1bba-4bc9-9f07-1100e8110232 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:23.798689 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-7b449a4c-1bba-4bc9-9f07-1100e8110232 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20" status: 200 len: 1321 microversion: 2.1 time: 0.338292 Apr 08 02:45:23.799637 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 50/101] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:23 2022] GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20 => generated 1321 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:23.802450 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-ea1fb89c-94c8-4044-9642-9b739a802b96 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:23.808895 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-ea1fb89c-94c8-4044-9642-9b739a802b96 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:23.810170 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-ea1fb89c-94c8-4044-9642-9b739a802b96 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1407 microversion: 2.20 time: 0.336295 Apr 08 02:45:23.810518 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-d677fa0f-e016-41a0-9359-f49c74035372 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:23.817706 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 52/102] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:45:23 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1407 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 02:45:23.818047 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-d677fa0f-e016-41a0-9359-f49c74035372 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 09e6abc6-19f4-4355-8309-fb3279d9b5e3] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:23.819349 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-d677fa0f-e016-41a0-9359-f49c74035372 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:23.819883 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-d677fa0f-e016-41a0-9359-f49c74035372 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:23.820748 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-d677fa0f-e016-41a0-9359-f49c74035372 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:23.821236 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-d677fa0f-e016-41a0-9359-f49c74035372 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:23.938566 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-d677fa0f-e016-41a0-9359-f49c74035372 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68bc45984974d6da1c9151c21dae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbf5bb7e51d4d2d8594d6d1d3a797a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:23.947343 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-d677fa0f-e016-41a0-9359-f49c74035372 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3" status: 200 len: 1298 microversion: 2.1 time: 0.146594 Apr 08 02:45:23.948166 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 51/103] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:23 2022] GET /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3 => generated 1298 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:24.821315 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-e7389384-d37b-4001-9b49-3d0bf01d40b9 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:24.822014 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-e7389384-d37b-4001-9b49-3d0bf01d40b9 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 6228b11f-244d-4e25-8b1f-e19a90cc8c20] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:24.829299 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-e7389384-d37b-4001-9b49-3d0bf01d40b9 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:24.829751 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-e7389384-d37b-4001-9b49-3d0bf01d40b9 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:24.830538 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-e7389384-d37b-4001-9b49-3d0bf01d40b9 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:24.830974 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-e7389384-d37b-4001-9b49-3d0bf01d40b9 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:24.833091 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-5904167a-6756-4908-a62c-b831f4ec6a25 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:24.833689 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-5904167a-6756-4908-a62c-b831f4ec6a25 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:24.840788 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-5904167a-6756-4908-a62c-b831f4ec6a25 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:24.841227 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-5904167a-6756-4908-a62c-b831f4ec6a25 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:24.843929 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-5904167a-6756-4908-a62c-b831f4ec6a25 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:24.843929 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-5904167a-6756-4908-a62c-b831f4ec6a25 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:25.148894 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-e7389384-d37b-4001-9b49-3d0bf01d40b9 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:25.158442 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-e7389384-d37b-4001-9b49-3d0bf01d40b9 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20" status: 200 len: 1321 microversion: 2.1 time: 0.346013 Apr 08 02:45:25.159151 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-5904167a-6756-4908-a62c-b831f4ec6a25 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:25.165656 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 53/104] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:24 2022] GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20 => generated 1321 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:25.176952 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-a2278338-fd2d-47fa-a80d-b18ec3b50959 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:25.177668 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-a2278338-fd2d-47fa-a80d-b18ec3b50959 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 09e6abc6-19f4-4355-8309-fb3279d9b5e3] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:25.180481 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-5904167a-6756-4908-a62c-b831f4ec6a25 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:25.185947 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-a2278338-fd2d-47fa-a80d-b18ec3b50959 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:25.186503 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-a2278338-fd2d-47fa-a80d-b18ec3b50959 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:25.187071 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-5904167a-6756-4908-a62c-b831f4ec6a25 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:25.187510 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-a2278338-fd2d-47fa-a80d-b18ec3b50959 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:25.188033 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-a2278338-fd2d-47fa-a80d-b18ec3b50959 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:25.188314 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-5904167a-6756-4908-a62c-b831f4ec6a25 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1407 microversion: 2.20 time: 0.364268 Apr 08 02:45:25.189455 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 52/105] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:45:24 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1407 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 02:45:25.324096 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-a2278338-fd2d-47fa-a80d-b18ec3b50959 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68bc45984974d6da1c9151c21dae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbf5bb7e51d4d2d8594d6d1d3a797a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:25.332751 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-a2278338-fd2d-47fa-a80d-b18ec3b50959 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3" status: 200 len: 1298 microversion: 2.1 time: 0.165932 Apr 08 02:45:25.333298 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 54/106] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:25 2022] GET /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3 => generated 1298 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:26.182069 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-8180f0ae-c3f5-4103-9fd2-c6c84267c408 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:26.183295 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-8180f0ae-c3f5-4103-9fd2-c6c84267c408 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 6228b11f-244d-4e25-8b1f-e19a90cc8c20] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:26.190849 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-8180f0ae-c3f5-4103-9fd2-c6c84267c408 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:26.192000 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-8180f0ae-c3f5-4103-9fd2-c6c84267c408 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:26.192980 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-8180f0ae-c3f5-4103-9fd2-c6c84267c408 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:26.193604 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-8180f0ae-c3f5-4103-9fd2-c6c84267c408 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:26.216234 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-92970d60-53b2-4b67-89d4-346f15875538 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:26.218242 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-92970d60-53b2-4b67-89d4-346f15875538 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:26.238993 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-92970d60-53b2-4b67-89d4-346f15875538 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:26.239445 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-92970d60-53b2-4b67-89d4-346f15875538 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:26.242354 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-92970d60-53b2-4b67-89d4-346f15875538 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:26.242822 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-92970d60-53b2-4b67-89d4-346f15875538 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:26.620392 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-92970d60-53b2-4b67-89d4-346f15875538 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:26.623718 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-8180f0ae-c3f5-4103-9fd2-c6c84267c408 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:26.636750 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-92970d60-53b2-4b67-89d4-346f15875538 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:26.636908 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-8180f0ae-c3f5-4103-9fd2-c6c84267c408 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20" status: 200 len: 1321 microversion: 2.1 time: 0.464593 Apr 08 02:45:26.637792 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 53/107] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:26 2022] GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20 => generated 1321 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:26.644937 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-92970d60-53b2-4b67-89d4-346f15875538 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:26.646317 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-92970d60-53b2-4b67-89d4-346f15875538 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1407 microversion: 2.20 time: 0.444013 Apr 08 02:45:26.649707 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-e5a78edd-182a-4bd5-b783-30cf5675b17e tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:26.650499 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-e5a78edd-182a-4bd5-b783-30cf5675b17e tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 09e6abc6-19f4-4355-8309-fb3279d9b5e3] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:26.658846 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-e5a78edd-182a-4bd5-b783-30cf5675b17e tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:26.659516 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-e5a78edd-182a-4bd5-b783-30cf5675b17e tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:26.660387 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 55/108] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:45:26 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1407 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:45:26.660644 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-e5a78edd-182a-4bd5-b783-30cf5675b17e tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:26.661430 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-e5a78edd-182a-4bd5-b783-30cf5675b17e tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:26.902276 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-e5a78edd-182a-4bd5-b783-30cf5675b17e tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68bc45984974d6da1c9151c21dae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbf5bb7e51d4d2d8594d6d1d3a797a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:26.912441 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-e5a78edd-182a-4bd5-b783-30cf5675b17e tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3" status: 200 len: 1365 microversion: 2.1 time: 0.273391 Apr 08 02:45:26.912982 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 54/109] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:26 2022] GET /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3 => generated 1365 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:26.990512 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [req-0ad5a0e6-7b36-4d92-82f6-8ac0eac87c4f req-7aa5b029-ba04-4536-94b0-3bd9a9a024d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09e6abc6-19f4-4355-8309-fb3279d9b5e3", "tag": "b5e78270-c26b-4b02-a6c8-efffc69a4c3c"}]} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:45:27.006625 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:45:27.006625 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: warnings.warn(msg) Apr 08 02:45:27.018582 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-0ad5a0e6-7b36-4d92-82f6-8ac0eac87c4f req-7aa5b029-ba04-4536-94b0-3bd9a9a024d8 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:27.022210 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-0ad5a0e6-7b36-4d92-82f6-8ac0eac87c4f req-7aa5b029-ba04-4536-94b0-3bd9a9a024d8 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:27.051247 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.compute.server_external_events [req-0ad5a0e6-7b36-4d92-82f6-8ac0eac87c4f req-7aa5b029-ba04-4536-94b0-3bd9a9a024d8 service nova] Creating event network-changed:b5e78270-c26b-4b02-a6c8-efffc69a4c3c for instance 09e6abc6-19f4-4355-8309-fb3279d9b5e3 on hv-cinder-83705 Apr 08 02:45:27.060326 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [req-0ad5a0e6-7b36-4d92-82f6-8ac0eac87c4f req-7aa5b029-ba04-4536-94b0-3bd9a9a024d8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088028 Apr 08 02:45:27.061092 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 56/110] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:45:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:45:27.659733 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-02ca8b8a-0250-4272-9731-34ae73d9843f tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:27.660603 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-02ca8b8a-0250-4272-9731-34ae73d9843f tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 6228b11f-244d-4e25-8b1f-e19a90cc8c20] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:27.668444 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-02ca8b8a-0250-4272-9731-34ae73d9843f tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:27.668896 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-02ca8b8a-0250-4272-9731-34ae73d9843f tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:27.669898 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-02ca8b8a-0250-4272-9731-34ae73d9843f tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:27.670482 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-02ca8b8a-0250-4272-9731-34ae73d9843f tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:27.677120 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-50c0d6b7-c233-4879-99a0-179319c7ba29 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:27.677930 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-50c0d6b7-c233-4879-99a0-179319c7ba29 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:27.687611 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-50c0d6b7-c233-4879-99a0-179319c7ba29 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:27.688834 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-50c0d6b7-c233-4879-99a0-179319c7ba29 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:27.691078 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-50c0d6b7-c233-4879-99a0-179319c7ba29 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:27.692543 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-50c0d6b7-c233-4879-99a0-179319c7ba29 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:28.000540 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-02ca8b8a-0250-4272-9731-34ae73d9843f tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:28.011458 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-02ca8b8a-0250-4272-9731-34ae73d9843f tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20" status: 200 len: 1321 microversion: 2.1 time: 0.360525 Apr 08 02:45:28.013422 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 55/111] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:27 2022] GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20 => generated 1321 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:28.023331 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-50c0d6b7-c233-4879-99a0-179319c7ba29 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:28.034345 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-457ccaa6-25a2-4036-b963-5e79db383c2b tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:28.035025 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-457ccaa6-25a2-4036-b963-5e79db383c2b tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 09e6abc6-19f4-4355-8309-fb3279d9b5e3] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:28.039027 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-50c0d6b7-c233-4879-99a0-179319c7ba29 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:28.043166 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-457ccaa6-25a2-4036-b963-5e79db383c2b tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:28.043640 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-457ccaa6-25a2-4036-b963-5e79db383c2b tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:28.044396 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-457ccaa6-25a2-4036-b963-5e79db383c2b tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:28.044825 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-457ccaa6-25a2-4036-b963-5e79db383c2b tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:28.045176 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-50c0d6b7-c233-4879-99a0-179319c7ba29 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:28.046434 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-50c0d6b7-c233-4879-99a0-179319c7ba29 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1407 microversion: 2.20 time: 0.381234 Apr 08 02:45:28.057553 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 57/112] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:45:27 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1407 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 02:45:28.256296 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-457ccaa6-25a2-4036-b963-5e79db383c2b tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68bc45984974d6da1c9151c21dae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbf5bb7e51d4d2d8594d6d1d3a797a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:28.264193 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-457ccaa6-25a2-4036-b963-5e79db383c2b tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3" status: 200 len: 1365 microversion: 2.1 time: 0.248734 Apr 08 02:45:28.264725 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 56/113] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:28 2022] GET /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3 => generated 1365 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:28.454748 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-722e7dee-8092-4bc9-92f1-53656538f40d tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0d8abb4b-d53e-4236-86ee-24b6283d8868"}} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:45:28.456078 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-722e7dee-8092-4bc9-92f1-53656538f40d tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] [instance: 2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:28.464024 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-722e7dee-8092-4bc9-92f1-53656538f40d tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:28.464569 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-722e7dee-8092-4bc9-92f1-53656538f40d tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:28.465540 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-722e7dee-8092-4bc9-92f1-53656538f40d tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:28.466151 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-722e7dee-8092-4bc9-92f1-53656538f40d tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:29.039105 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-ed20cd81-55f0-407a-8fe5-8a1b2f54dd4f tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:29.039909 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-ed20cd81-55f0-407a-8fe5-8a1b2f54dd4f tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 6228b11f-244d-4e25-8b1f-e19a90cc8c20] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:29.049446 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-ed20cd81-55f0-407a-8fe5-8a1b2f54dd4f tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:29.049965 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-ed20cd81-55f0-407a-8fe5-8a1b2f54dd4f tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:29.052042 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-ed20cd81-55f0-407a-8fe5-8a1b2f54dd4f tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:29.052842 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-ed20cd81-55f0-407a-8fe5-8a1b2f54dd4f tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:29.065314 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-722e7dee-8092-4bc9-92f1-53656538f40d tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] 10.222.0.48 "POST /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.620050 Apr 08 02:45:29.068182 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 58/114] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Apr 8 02:45:28 2022] POST /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9/os-volume_attachments => generated 194 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:45:29.099147 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-bbd49b17-fe3e-4e2d-8639-6251c951f49f tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:29.104636 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-bbd49b17-fe3e-4e2d-8639-6251c951f49f tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:29.121378 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-bbd49b17-fe3e-4e2d-8639-6251c951f49f tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:29.121824 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-bbd49b17-fe3e-4e2d-8639-6251c951f49f tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:29.122600 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-bbd49b17-fe3e-4e2d-8639-6251c951f49f tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:29.123050 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-bbd49b17-fe3e-4e2d-8639-6251c951f49f tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:29.453229 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-ed20cd81-55f0-407a-8fe5-8a1b2f54dd4f tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:29.465080 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-ed20cd81-55f0-407a-8fe5-8a1b2f54dd4f tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20" status: 200 len: 1321 microversion: 2.1 time: 0.436837 Apr 08 02:45:29.466531 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 57/115] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:29 2022] GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20 => generated 1321 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:29.479328 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-b57070f9-5079-4d2a-afee-f3cee3894df6 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:29.480948 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-b57070f9-5079-4d2a-afee-f3cee3894df6 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 09e6abc6-19f4-4355-8309-fb3279d9b5e3] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:29.490586 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b57070f9-5079-4d2a-afee-f3cee3894df6 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:29.491289 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b57070f9-5079-4d2a-afee-f3cee3894df6 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:29.492257 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b57070f9-5079-4d2a-afee-f3cee3894df6 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:29.492845 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b57070f9-5079-4d2a-afee-f3cee3894df6 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:29.508189 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-bbd49b17-fe3e-4e2d-8639-6251c951f49f tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:29.526815 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-bbd49b17-fe3e-4e2d-8639-6251c951f49f tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:29.532979 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-bbd49b17-fe3e-4e2d-8639-6251c951f49f tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:29.534188 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-bbd49b17-fe3e-4e2d-8639-6251c951f49f tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1407 microversion: 2.20 time: 0.456748 Apr 08 02:45:29.534905 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 59/116] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:45:29 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1407 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:45:29.760994 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-b57070f9-5079-4d2a-afee-f3cee3894df6 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68bc45984974d6da1c9151c21dae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbf5bb7e51d4d2d8594d6d1d3a797a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:29.771062 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-b57070f9-5079-4d2a-afee-f3cee3894df6 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3" status: 200 len: 1365 microversion: 2.1 time: 0.302654 Apr 08 02:45:29.772205 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 58/117] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:29 2022] GET /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3 => generated 1365 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:30.488713 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-454837c7-b431-4ae6-805d-05182edab8d4 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:30.489317 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-454837c7-b431-4ae6-805d-05182edab8d4 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 6228b11f-244d-4e25-8b1f-e19a90cc8c20] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:30.501092 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-454837c7-b431-4ae6-805d-05182edab8d4 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:30.501772 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-454837c7-b431-4ae6-805d-05182edab8d4 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:30.505388 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-454837c7-b431-4ae6-805d-05182edab8d4 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:30.506068 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-454837c7-b431-4ae6-805d-05182edab8d4 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:30.562442 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-06547f34-1f6c-4ae8-9149-593f20699504 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:30.563095 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-06547f34-1f6c-4ae8-9149-593f20699504 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:30.582476 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-06547f34-1f6c-4ae8-9149-593f20699504 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:30.584019 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-06547f34-1f6c-4ae8-9149-593f20699504 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:30.584810 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-06547f34-1f6c-4ae8-9149-593f20699504 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:30.585241 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-06547f34-1f6c-4ae8-9149-593f20699504 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:30.965309 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-454837c7-b431-4ae6-805d-05182edab8d4 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:30.978848 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-06547f34-1f6c-4ae8-9149-593f20699504 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:30.989434 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-454837c7-b431-4ae6-805d-05182edab8d4 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20" status: 200 len: 1321 microversion: 2.1 time: 0.510521 Apr 08 02:45:30.992717 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 60/118] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:30 2022] GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20 => generated 1321 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:31.002919 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-06547f34-1f6c-4ae8-9149-593f20699504 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:31.009770 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-06547f34-1f6c-4ae8-9149-593f20699504 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:31.011082 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-06547f34-1f6c-4ae8-9149-593f20699504 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1407 microversion: 2.20 time: 0.461769 Apr 08 02:45:31.012139 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 59/119] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:45:30 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1407 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 02:45:31.021641 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-589b0a24-d92c-46e0-abe0-d8bd5620965e tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:31.022351 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-589b0a24-d92c-46e0-abe0-d8bd5620965e tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 09e6abc6-19f4-4355-8309-fb3279d9b5e3] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:31.032068 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-589b0a24-d92c-46e0-abe0-d8bd5620965e tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:31.032551 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-589b0a24-d92c-46e0-abe0-d8bd5620965e tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:31.033463 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-589b0a24-d92c-46e0-abe0-d8bd5620965e tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:31.034150 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-589b0a24-d92c-46e0-abe0-d8bd5620965e tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:31.312989 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-589b0a24-d92c-46e0-abe0-d8bd5620965e tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68bc45984974d6da1c9151c21dae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbf5bb7e51d4d2d8594d6d1d3a797a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:31.322144 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-589b0a24-d92c-46e0-abe0-d8bd5620965e tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3" status: 200 len: 1365 microversion: 2.1 time: 0.328120 Apr 08 02:45:31.332125 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 61/120] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:30 2022] GET /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3 => generated 1365 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:32.011790 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-427c1e4d-fc6a-4db6-9719-ef3bc4673a2c tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:32.012374 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-427c1e4d-fc6a-4db6-9719-ef3bc4673a2c tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 6228b11f-244d-4e25-8b1f-e19a90cc8c20] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:32.020958 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-427c1e4d-fc6a-4db6-9719-ef3bc4673a2c tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:32.021504 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-427c1e4d-fc6a-4db6-9719-ef3bc4673a2c tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:32.022386 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-427c1e4d-fc6a-4db6-9719-ef3bc4673a2c tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:32.023171 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-427c1e4d-fc6a-4db6-9719-ef3bc4673a2c tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:32.040756 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-8757bb8e-5aa0-4691-9b62-c9ba3418c2b5 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:32.041578 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-8757bb8e-5aa0-4691-9b62-c9ba3418c2b5 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:32.052234 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-8757bb8e-5aa0-4691-9b62-c9ba3418c2b5 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:32.053354 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-8757bb8e-5aa0-4691-9b62-c9ba3418c2b5 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:32.054586 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-8757bb8e-5aa0-4691-9b62-c9ba3418c2b5 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:32.055831 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-8757bb8e-5aa0-4691-9b62-c9ba3418c2b5 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:32.354925 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-427c1e4d-fc6a-4db6-9719-ef3bc4673a2c tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:32.367352 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-8757bb8e-5aa0-4691-9b62-c9ba3418c2b5 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:32.368721 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-427c1e4d-fc6a-4db6-9719-ef3bc4673a2c tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20" status: 200 len: 1321 microversion: 2.1 time: 0.366214 Apr 08 02:45:32.379389 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 60/121] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:32 2022] GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20 => generated 1321 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:32.391567 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-81644611-971b-45d5-aee9-c1c4759a6c8e tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:32.392242 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-81644611-971b-45d5-aee9-c1c4759a6c8e tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 09e6abc6-19f4-4355-8309-fb3279d9b5e3] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:32.397590 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-8757bb8e-5aa0-4691-9b62-c9ba3418c2b5 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:32.401925 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-81644611-971b-45d5-aee9-c1c4759a6c8e tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:32.402591 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-81644611-971b-45d5-aee9-c1c4759a6c8e tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:32.403674 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-81644611-971b-45d5-aee9-c1c4759a6c8e tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:32.404806 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-81644611-971b-45d5-aee9-c1c4759a6c8e tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:32.408721 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-8757bb8e-5aa0-4691-9b62-c9ba3418c2b5 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:32.411686 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-8757bb8e-5aa0-4691-9b62-c9ba3418c2b5 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1407 microversion: 2.20 time: 0.382866 Apr 08 02:45:32.413025 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 62/122] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:45:32 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1407 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 02:45:32.625616 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-81644611-971b-45d5-aee9-c1c4759a6c8e tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68bc45984974d6da1c9151c21dae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbf5bb7e51d4d2d8594d6d1d3a797a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:32.634072 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-81644611-971b-45d5-aee9-c1c4759a6c8e tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3" status: 200 len: 1365 microversion: 2.1 time: 0.253532 Apr 08 02:45:32.634602 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 61/123] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:32 2022] GET /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3 => generated 1365 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:33.391791 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-0841efb0-ba4d-4c66-8dad-37802b622b80 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:33.392313 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-0841efb0-ba4d-4c66-8dad-37802b622b80 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 6228b11f-244d-4e25-8b1f-e19a90cc8c20] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:33.400471 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-0841efb0-ba4d-4c66-8dad-37802b622b80 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:33.400814 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-0841efb0-ba4d-4c66-8dad-37802b622b80 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:33.401763 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-0841efb0-ba4d-4c66-8dad-37802b622b80 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:33.402243 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-0841efb0-ba4d-4c66-8dad-37802b622b80 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:33.439204 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-686af3d7-73ce-46dc-a85c-eff47aeedf19 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:33.440436 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-686af3d7-73ce-46dc-a85c-eff47aeedf19 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:33.458514 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-686af3d7-73ce-46dc-a85c-eff47aeedf19 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:33.458984 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-686af3d7-73ce-46dc-a85c-eff47aeedf19 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:33.459765 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-686af3d7-73ce-46dc-a85c-eff47aeedf19 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:33.460195 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-686af3d7-73ce-46dc-a85c-eff47aeedf19 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:33.889972 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-0841efb0-ba4d-4c66-8dad-37802b622b80 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:33.907437 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-0841efb0-ba4d-4c66-8dad-37802b622b80 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20" status: 200 len: 1321 microversion: 2.1 time: 0.525191 Apr 08 02:45:33.908292 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 63/124] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:33 2022] GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20 => generated 1321 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:33.914316 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-686af3d7-73ce-46dc-a85c-eff47aeedf19 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:33.919596 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-ebb51148-3bdb-4415-bbe8-a8d21716e440 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:33.920198 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-ebb51148-3bdb-4415-bbe8-a8d21716e440 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 09e6abc6-19f4-4355-8309-fb3279d9b5e3] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:33.930539 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ebb51148-3bdb-4415-bbe8-a8d21716e440 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:33.931228 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ebb51148-3bdb-4415-bbe8-a8d21716e440 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:33.932151 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ebb51148-3bdb-4415-bbe8-a8d21716e440 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:33.932722 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ebb51148-3bdb-4415-bbe8-a8d21716e440 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:33.967719 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-686af3d7-73ce-46dc-a85c-eff47aeedf19 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:33.982310 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-686af3d7-73ce-46dc-a85c-eff47aeedf19 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:33.983455 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-686af3d7-73ce-46dc-a85c-eff47aeedf19 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1407 microversion: 2.20 time: 0.557965 Apr 08 02:45:33.990640 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 62/125] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:45:33 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1407 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 02:45:34.103632 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [req-93f2deb2-6f6b-4f82-95ab-a17cacc4f865 req-74345aed-5fea-4d96-ac9a-c22e5922b076 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe2c4fd0-315a-4d94-8913-a661cdfa293a", "name": "network-vif-plugged", "status": "completed", "tag": "1765d10f-4f9f-4883-99d5-299517e80053"}]} {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:45:34.112724 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:45:34.112724 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: warnings.warn(msg) Apr 08 02:45:34.122705 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-93f2deb2-6f6b-4f82-95ab-a17cacc4f865 req-74345aed-5fea-4d96-ac9a-c22e5922b076 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:34.123479 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-93f2deb2-6f6b-4f82-95ab-a17cacc4f865 req-74345aed-5fea-4d96-ac9a-c22e5922b076 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:34.147080 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.compute.server_external_events [req-93f2deb2-6f6b-4f82-95ab-a17cacc4f865 req-74345aed-5fea-4d96-ac9a-c22e5922b076 service nova] Creating event network-vif-plugged:1765d10f-4f9f-4883-99d5-299517e80053 for instance fe2c4fd0-315a-4d94-8913-a661cdfa293a on hv-cinder-83705 Apr 08 02:45:34.153864 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [req-93f2deb2-6f6b-4f82-95ab-a17cacc4f865 req-74345aed-5fea-4d96-ac9a-c22e5922b076 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065028 Apr 08 02:45:34.154940 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 63/126] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:45:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 02:45:34.296430 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-ebb51148-3bdb-4415-bbe8-a8d21716e440 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68bc45984974d6da1c9151c21dae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbf5bb7e51d4d2d8594d6d1d3a797a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:34.308679 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-ebb51148-3bdb-4415-bbe8-a8d21716e440 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3" status: 200 len: 1365 microversion: 2.1 time: 0.398754 Apr 08 02:45:34.309928 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 64/127] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:33 2022] GET /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3 => generated 1365 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:34.936862 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-5fc8cb00-a653-4696-a53e-f43e378bd1b4 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:34.937503 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-5fc8cb00-a653-4696-a53e-f43e378bd1b4 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 6228b11f-244d-4e25-8b1f-e19a90cc8c20] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:34.977511 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-5fc8cb00-a653-4696-a53e-f43e378bd1b4 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:34.980028 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-5fc8cb00-a653-4696-a53e-f43e378bd1b4 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:34.981097 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-5fc8cb00-a653-4696-a53e-f43e378bd1b4 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:34.982014 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-5fc8cb00-a653-4696-a53e-f43e378bd1b4 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:35.012171 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-8a1f11d0-95d0-4a3f-9bdc-5136eff68a2a tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:35.019356 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-8a1f11d0-95d0-4a3f-9bdc-5136eff68a2a tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:35.038369 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-8a1f11d0-95d0-4a3f-9bdc-5136eff68a2a tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:35.040220 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-8a1f11d0-95d0-4a3f-9bdc-5136eff68a2a tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:35.041248 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-8a1f11d0-95d0-4a3f-9bdc-5136eff68a2a tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:35.043004 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-8a1f11d0-95d0-4a3f-9bdc-5136eff68a2a tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:35.497027 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-5fc8cb00-a653-4696-a53e-f43e378bd1b4 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:35.507045 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-5fc8cb00-a653-4696-a53e-f43e378bd1b4 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20" status: 200 len: 1321 microversion: 2.1 time: 0.585871 Apr 08 02:45:35.508200 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 64/128] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:34 2022] GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20 => generated 1321 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:35.518223 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-8a1f11d0-95d0-4a3f-9bdc-5136eff68a2a tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:35.521019 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-308a8fb9-9115-4e22-9e53-d18e600a8c1a tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:35.521846 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-308a8fb9-9115-4e22-9e53-d18e600a8c1a tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 09e6abc6-19f4-4355-8309-fb3279d9b5e3] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:35.529253 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-308a8fb9-9115-4e22-9e53-d18e600a8c1a tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:35.529706 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-308a8fb9-9115-4e22-9e53-d18e600a8c1a tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:35.530488 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-308a8fb9-9115-4e22-9e53-d18e600a8c1a tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:35.532466 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-308a8fb9-9115-4e22-9e53-d18e600a8c1a tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:35.551446 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-8a1f11d0-95d0-4a3f-9bdc-5136eff68a2a tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:35.564224 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-8a1f11d0-95d0-4a3f-9bdc-5136eff68a2a tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:35.565323 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-8a1f11d0-95d0-4a3f-9bdc-5136eff68a2a tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1407 microversion: 2.20 time: 0.567915 Apr 08 02:45:35.575874 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 65/129] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:45:34 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1407 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 02:45:35.792492 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-308a8fb9-9115-4e22-9e53-d18e600a8c1a tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68bc45984974d6da1c9151c21dae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbf5bb7e51d4d2d8594d6d1d3a797a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:35.803508 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-308a8fb9-9115-4e22-9e53-d18e600a8c1a tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3" status: 200 len: 1365 microversion: 2.1 time: 0.294054 Apr 08 02:45:35.804354 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 65/130] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:35 2022] GET /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3 => generated 1365 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:36.252815 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [req-80b8ce9a-32e4-4c7e-843f-d4177e0cb262 req-7fb93040-d7b7-46db-a663-32a0456189cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6228b11f-244d-4e25-8b1f-e19a90cc8c20", "name": "network-vif-plugged", "status": "completed", "tag": "8cf7f363-1f61-4342-8249-2e47822bc532"}, {"server_uuid": "e44bc1d2-0741-4081-9165-b0aca9008eaf", "name": "network-vif-plugged", "status": "completed", "tag": "e1447a33-5dc8-44ca-8978-a2f1cdaaab34"}]} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:45:36.259687 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:45:36.259687 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: warnings.warn(msg) Apr 08 02:45:36.273575 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-80b8ce9a-32e4-4c7e-843f-d4177e0cb262 req-7fb93040-d7b7-46db-a663-32a0456189cd service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:36.274099 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-80b8ce9a-32e4-4c7e-843f-d4177e0cb262 req-7fb93040-d7b7-46db-a663-32a0456189cd service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:36.296228 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.compute.server_external_events [req-80b8ce9a-32e4-4c7e-843f-d4177e0cb262 req-7fb93040-d7b7-46db-a663-32a0456189cd service nova] Creating event network-vif-plugged:8cf7f363-1f61-4342-8249-2e47822bc532 for instance 6228b11f-244d-4e25-8b1f-e19a90cc8c20 on hv-cinder-83705 Apr 08 02:45:36.296980 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.compute.server_external_events [req-80b8ce9a-32e4-4c7e-843f-d4177e0cb262 req-7fb93040-d7b7-46db-a663-32a0456189cd service nova] Creating event network-vif-plugged:e1447a33-5dc8-44ca-8978-a2f1cdaaab34 for instance e44bc1d2-0741-4081-9165-b0aca9008eaf on hv-cinder-83705 Apr 08 02:45:36.304773 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [req-80b8ce9a-32e4-4c7e-843f-d4177e0cb262 req-7fb93040-d7b7-46db-a663-32a0456189cd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.062512 Apr 08 02:45:36.305787 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 66/131] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:45:36 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:45:36.533227 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-92a16aab-cb91-4b26-9f1a-dba9c9f852e3 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:36.535330 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-92a16aab-cb91-4b26-9f1a-dba9c9f852e3 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 6228b11f-244d-4e25-8b1f-e19a90cc8c20] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:36.547529 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-92a16aab-cb91-4b26-9f1a-dba9c9f852e3 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:36.548252 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-92a16aab-cb91-4b26-9f1a-dba9c9f852e3 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:36.549347 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-92a16aab-cb91-4b26-9f1a-dba9c9f852e3 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:36.550015 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-92a16aab-cb91-4b26-9f1a-dba9c9f852e3 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:36.592413 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-4e1579ce-c430-41bf-8e81-7bbb227f71a1 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:36.593816 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-4e1579ce-c430-41bf-8e81-7bbb227f71a1 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:36.618917 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-4e1579ce-c430-41bf-8e81-7bbb227f71a1 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:36.619376 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-4e1579ce-c430-41bf-8e81-7bbb227f71a1 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:36.631725 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-4e1579ce-c430-41bf-8e81-7bbb227f71a1 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:36.632607 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-4e1579ce-c430-41bf-8e81-7bbb227f71a1 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:36.920996 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-92a16aab-cb91-4b26-9f1a-dba9c9f852e3 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:36.936722 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-92a16aab-cb91-4b26-9f1a-dba9c9f852e3 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20" status: 200 len: 1321 microversion: 2.1 time: 0.414824 Apr 08 02:45:36.937285 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 66/132] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:36 2022] GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20 => generated 1321 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:36.964589 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-db1edf39-7409-47d4-ad98-436e9f5ac1d9 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:36.965221 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-db1edf39-7409-47d4-ad98-436e9f5ac1d9 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 09e6abc6-19f4-4355-8309-fb3279d9b5e3] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:36.982027 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-db1edf39-7409-47d4-ad98-436e9f5ac1d9 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:36.982479 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-db1edf39-7409-47d4-ad98-436e9f5ac1d9 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:36.983295 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-db1edf39-7409-47d4-ad98-436e9f5ac1d9 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:36.983732 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-db1edf39-7409-47d4-ad98-436e9f5ac1d9 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:37.073286 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-4e1579ce-c430-41bf-8e81-7bbb227f71a1 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:37.135481 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-4e1579ce-c430-41bf-8e81-7bbb227f71a1 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:37.168788 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-4e1579ce-c430-41bf-8e81-7bbb227f71a1 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:37.179320 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-4e1579ce-c430-41bf-8e81-7bbb227f71a1 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1407 microversion: 2.20 time: 0.594795 Apr 08 02:45:37.195158 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 67/133] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:45:36 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1407 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 02:45:37.388723 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-db1edf39-7409-47d4-ad98-436e9f5ac1d9 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68bc45984974d6da1c9151c21dae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbf5bb7e51d4d2d8594d6d1d3a797a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:37.408185 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-db1edf39-7409-47d4-ad98-436e9f5ac1d9 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3" status: 200 len: 1365 microversion: 2.1 time: 0.469828 Apr 08 02:45:37.411186 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 67/134] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:36 2022] GET /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3 => generated 1365 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:37.964689 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-a2859a6e-684f-4502-87c8-4a8db5bf4009 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:37.966537 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-a2859a6e-684f-4502-87c8-4a8db5bf4009 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 6228b11f-244d-4e25-8b1f-e19a90cc8c20] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:37.978138 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-a2859a6e-684f-4502-87c8-4a8db5bf4009 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:37.978964 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-a2859a6e-684f-4502-87c8-4a8db5bf4009 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:37.980082 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-a2859a6e-684f-4502-87c8-4a8db5bf4009 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:37.980739 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-a2859a6e-684f-4502-87c8-4a8db5bf4009 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:38.210994 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-33eb6790-7a27-4ce1-bbec-5df0c7dfc8d2 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:38.211623 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-33eb6790-7a27-4ce1-bbec-5df0c7dfc8d2 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:38.228485 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-33eb6790-7a27-4ce1-bbec-5df0c7dfc8d2 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:38.228935 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-33eb6790-7a27-4ce1-bbec-5df0c7dfc8d2 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:38.231599 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-33eb6790-7a27-4ce1-bbec-5df0c7dfc8d2 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:38.232059 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-33eb6790-7a27-4ce1-bbec-5df0c7dfc8d2 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:38.396748 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-a2859a6e-684f-4502-87c8-4a8db5bf4009 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:38.406023 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-a2859a6e-684f-4502-87c8-4a8db5bf4009 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20" status: 200 len: 1321 microversion: 2.1 time: 0.456208 Apr 08 02:45:38.407259 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 68/135] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:37 2022] GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20 => generated 1321 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:38.417489 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [req-e6892ba8-d515-4f47-929b-a084d1263d15 req-5d2d77be-24d9-4e73-8d87-34b0a0ee1c92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09e6abc6-19f4-4355-8309-fb3279d9b5e3", "name": "network-vif-plugged", "status": "completed", "tag": "b5e78270-c26b-4b02-a6c8-efffc69a4c3c"}]} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:45:38.426352 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:45:38.426352 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: warnings.warn(msg) Apr 08 02:45:38.436064 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-e6892ba8-d515-4f47-929b-a084d1263d15 req-5d2d77be-24d9-4e73-8d87-34b0a0ee1c92 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:38.436720 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-e6892ba8-d515-4f47-929b-a084d1263d15 req-5d2d77be-24d9-4e73-8d87-34b0a0ee1c92 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:38.465710 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.compute.server_external_events [req-e6892ba8-d515-4f47-929b-a084d1263d15 req-5d2d77be-24d9-4e73-8d87-34b0a0ee1c92 service nova] Creating event network-vif-plugged:b5e78270-c26b-4b02-a6c8-efffc69a4c3c for instance 09e6abc6-19f4-4355-8309-fb3279d9b5e3 on hv-cinder-83705 Apr 08 02:45:38.471061 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [req-e6892ba8-d515-4f47-929b-a084d1263d15 req-5d2d77be-24d9-4e73-8d87-34b0a0ee1c92 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062300 Apr 08 02:45:38.474532 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 69/136] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:45:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:45:38.486031 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-8a8873e4-4499-4c1f-9eb8-1204d3c08323 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:38.486843 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-8a8873e4-4499-4c1f-9eb8-1204d3c08323 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 09e6abc6-19f4-4355-8309-fb3279d9b5e3] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:38.494996 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-8a8873e4-4499-4c1f-9eb8-1204d3c08323 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:38.495579 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-8a8873e4-4499-4c1f-9eb8-1204d3c08323 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:38.496362 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-8a8873e4-4499-4c1f-9eb8-1204d3c08323 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:38.496798 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-8a8873e4-4499-4c1f-9eb8-1204d3c08323 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:38.544207 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-33eb6790-7a27-4ce1-bbec-5df0c7dfc8d2 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:38.557799 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-33eb6790-7a27-4ce1-bbec-5df0c7dfc8d2 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:38.563891 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-33eb6790-7a27-4ce1-bbec-5df0c7dfc8d2 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:38.565271 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-33eb6790-7a27-4ce1-bbec-5df0c7dfc8d2 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1407 microversion: 2.20 time: 0.367824 Apr 08 02:45:38.566005 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 68/137] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:45:38 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1407 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 02:45:38.728936 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-8a8873e4-4499-4c1f-9eb8-1204d3c08323 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68bc45984974d6da1c9151c21dae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbf5bb7e51d4d2d8594d6d1d3a797a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:38.737083 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-8a8873e4-4499-4c1f-9eb8-1204d3c08323 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3" status: 200 len: 1365 microversion: 2.1 time: 0.261241 Apr 08 02:45:38.737892 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 70/138] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:38 2022] GET /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3 => generated 1365 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:39.428880 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-bad6a94d-6107-41a0-8c4e-0def60855906 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:39.429567 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-bad6a94d-6107-41a0-8c4e-0def60855906 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 6228b11f-244d-4e25-8b1f-e19a90cc8c20] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:39.436717 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-bad6a94d-6107-41a0-8c4e-0def60855906 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:39.437232 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-bad6a94d-6107-41a0-8c4e-0def60855906 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:39.438060 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-bad6a94d-6107-41a0-8c4e-0def60855906 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:39.438552 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-bad6a94d-6107-41a0-8c4e-0def60855906 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:39.594481 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-d839494c-a25a-4445-976b-7fdf3fdca018 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:39.595121 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-d839494c-a25a-4445-976b-7fdf3fdca018 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:39.603296 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-d839494c-a25a-4445-976b-7fdf3fdca018 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:39.603780 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-d839494c-a25a-4445-976b-7fdf3fdca018 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:39.604557 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-d839494c-a25a-4445-976b-7fdf3fdca018 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:39.604988 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-d839494c-a25a-4445-976b-7fdf3fdca018 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:39.663706 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-bad6a94d-6107-41a0-8c4e-0def60855906 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:39.672336 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-bad6a94d-6107-41a0-8c4e-0def60855906 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20" status: 200 len: 1321 microversion: 2.1 time: 0.252996 Apr 08 02:45:39.672996 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 69/139] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:39 2022] GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20 => generated 1321 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:39.758385 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-8169f576-a4dc-41aa-9591-7be3aac79894 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:39.759128 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-8169f576-a4dc-41aa-9591-7be3aac79894 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 09e6abc6-19f4-4355-8309-fb3279d9b5e3] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:39.766983 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-8169f576-a4dc-41aa-9591-7be3aac79894 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:39.767427 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-8169f576-a4dc-41aa-9591-7be3aac79894 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:39.768198 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-8169f576-a4dc-41aa-9591-7be3aac79894 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:39.768626 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-8169f576-a4dc-41aa-9591-7be3aac79894 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:39.818222 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-d839494c-a25a-4445-976b-7fdf3fdca018 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:39.832151 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-d839494c-a25a-4445-976b-7fdf3fdca018 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:39.838575 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-d839494c-a25a-4445-976b-7fdf3fdca018 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:39.839694 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-d839494c-a25a-4445-976b-7fdf3fdca018 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1407 microversion: 2.20 time: 0.254316 Apr 08 02:45:39.841802 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 71/140] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:45:39 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1407 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 02:45:40.020359 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-8169f576-a4dc-41aa-9591-7be3aac79894 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68bc45984974d6da1c9151c21dae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbf5bb7e51d4d2d8594d6d1d3a797a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:40.030055 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-8169f576-a4dc-41aa-9591-7be3aac79894 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3" status: 200 len: 1365 microversion: 2.1 time: 0.280741 Apr 08 02:45:40.030711 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 70/141] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:39 2022] GET /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3 => generated 1365 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:45:40.696514 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-58bbfc9b-21f5-4fd9-83ff-52711ac23be2 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:40.697170 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-58bbfc9b-21f5-4fd9-83ff-52711ac23be2 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 6228b11f-244d-4e25-8b1f-e19a90cc8c20] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:40.705035 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-58bbfc9b-21f5-4fd9-83ff-52711ac23be2 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:40.705461 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-58bbfc9b-21f5-4fd9-83ff-52711ac23be2 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:40.706397 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-58bbfc9b-21f5-4fd9-83ff-52711ac23be2 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:40.707164 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-58bbfc9b-21f5-4fd9-83ff-52711ac23be2 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:40.864847 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-6d7fd3da-2a27-459e-ac8c-2b69731c82c1 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:40.865442 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-6d7fd3da-2a27-459e-ac8c-2b69731c82c1 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:40.873375 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-6d7fd3da-2a27-459e-ac8c-2b69731c82c1 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:40.874035 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-6d7fd3da-2a27-459e-ac8c-2b69731c82c1 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:40.875537 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-6d7fd3da-2a27-459e-ac8c-2b69731c82c1 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:40.876298 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-6d7fd3da-2a27-459e-ac8c-2b69731c82c1 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:40.933873 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-58bbfc9b-21f5-4fd9-83ff-52711ac23be2 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:40.943037 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-58bbfc9b-21f5-4fd9-83ff-52711ac23be2 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20" status: 200 len: 1321 microversion: 2.1 time: 0.256540 Apr 08 02:45:40.944631 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 72/142] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:40 2022] GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20 => generated 1321 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:41.052632 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-30f1577a-ca95-459f-870f-89dbcf98a688 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:41.053234 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-30f1577a-ca95-459f-870f-89dbcf98a688 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 09e6abc6-19f4-4355-8309-fb3279d9b5e3] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:41.060502 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-30f1577a-ca95-459f-870f-89dbcf98a688 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:41.060946 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-30f1577a-ca95-459f-870f-89dbcf98a688 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:41.061718 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-30f1577a-ca95-459f-870f-89dbcf98a688 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:41.062148 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-30f1577a-ca95-459f-870f-89dbcf98a688 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:41.096423 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-6d7fd3da-2a27-459e-ac8c-2b69731c82c1 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:41.109481 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-6d7fd3da-2a27-459e-ac8c-2b69731c82c1 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:41.115529 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-6d7fd3da-2a27-459e-ac8c-2b69731c82c1 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:41.116602 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-6d7fd3da-2a27-459e-ac8c-2b69731c82c1 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1407 microversion: 2.20 time: 0.262754 Apr 08 02:45:41.117127 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 71/143] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:45:40 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1407 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 02:45:41.272890 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-30f1577a-ca95-459f-870f-89dbcf98a688 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68bc45984974d6da1c9151c21dae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbf5bb7e51d4d2d8594d6d1d3a797a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:41.280876 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-30f1577a-ca95-459f-870f-89dbcf98a688 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3" status: 200 len: 1365 microversion: 2.1 time: 0.237557 Apr 08 02:45:41.281408 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 73/144] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:41 2022] GET /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3 => generated 1365 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:45:41.965548 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-43b0d75b-1fa9-48ef-a33b-a0f72e898a9e tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:41.966146 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-43b0d75b-1fa9-48ef-a33b-a0f72e898a9e tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 6228b11f-244d-4e25-8b1f-e19a90cc8c20] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:41.974175 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-43b0d75b-1fa9-48ef-a33b-a0f72e898a9e tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:41.974610 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-43b0d75b-1fa9-48ef-a33b-a0f72e898a9e tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:41.975389 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-43b0d75b-1fa9-48ef-a33b-a0f72e898a9e tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:41.975811 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-43b0d75b-1fa9-48ef-a33b-a0f72e898a9e tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:42.139404 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-6ce7a0e4-f856-4fc9-b2d1-9a6474355b72 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:42.139994 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-6ce7a0e4-f856-4fc9-b2d1-9a6474355b72 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:42.148255 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-6ce7a0e4-f856-4fc9-b2d1-9a6474355b72 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:42.148690 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-6ce7a0e4-f856-4fc9-b2d1-9a6474355b72 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:42.149495 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-6ce7a0e4-f856-4fc9-b2d1-9a6474355b72 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:42.149918 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-6ce7a0e4-f856-4fc9-b2d1-9a6474355b72 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:42.181760 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-43b0d75b-1fa9-48ef-a33b-a0f72e898a9e tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:42.190127 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-43b0d75b-1fa9-48ef-a33b-a0f72e898a9e tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20" status: 200 len: 1321 microversion: 2.1 time: 0.233922 Apr 08 02:45:42.190752 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 72/145] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:41 2022] GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20 => generated 1321 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:42.303405 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-5ce671ff-2576-4510-8bc6-666c1bb56655 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:42.304014 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-5ce671ff-2576-4510-8bc6-666c1bb56655 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 09e6abc6-19f4-4355-8309-fb3279d9b5e3] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:42.311258 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-5ce671ff-2576-4510-8bc6-666c1bb56655 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:42.311708 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-5ce671ff-2576-4510-8bc6-666c1bb56655 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:42.312481 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-5ce671ff-2576-4510-8bc6-666c1bb56655 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:42.312917 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-5ce671ff-2576-4510-8bc6-666c1bb56655 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:42.352827 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-6ce7a0e4-f856-4fc9-b2d1-9a6474355b72 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:42.368058 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-6ce7a0e4-f856-4fc9-b2d1-9a6474355b72 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:42.374110 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-6ce7a0e4-f856-4fc9-b2d1-9a6474355b72 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:42.375221 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-6ce7a0e4-f856-4fc9-b2d1-9a6474355b72 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1407 microversion: 2.20 time: 0.244729 Apr 08 02:45:42.375958 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 74/146] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:45:42 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1407 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 02:45:42.521610 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-5ce671ff-2576-4510-8bc6-666c1bb56655 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68bc45984974d6da1c9151c21dae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbf5bb7e51d4d2d8594d6d1d3a797a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:42.529545 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-5ce671ff-2576-4510-8bc6-666c1bb56655 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3" status: 200 len: 1365 microversion: 2.1 time: 0.236124 Apr 08 02:45:42.530077 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 73/147] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:42 2022] GET /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3 => generated 1365 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:45:43.212035 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-91eebc23-d23f-46d4-a851-fe4244983756 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:43.212640 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-91eebc23-d23f-46d4-a851-fe4244983756 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 6228b11f-244d-4e25-8b1f-e19a90cc8c20] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:43.219707 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-91eebc23-d23f-46d4-a851-fe4244983756 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:43.220143 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-91eebc23-d23f-46d4-a851-fe4244983756 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:43.220899 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-91eebc23-d23f-46d4-a851-fe4244983756 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:43.221331 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-91eebc23-d23f-46d4-a851-fe4244983756 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:43.401620 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-c71c34ce-0c00-43ed-8671-39e955e2e555 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:43.402223 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-c71c34ce-0c00-43ed-8671-39e955e2e555 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:43.409723 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c71c34ce-0c00-43ed-8671-39e955e2e555 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:43.410279 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c71c34ce-0c00-43ed-8671-39e955e2e555 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:43.411084 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c71c34ce-0c00-43ed-8671-39e955e2e555 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:43.411509 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c71c34ce-0c00-43ed-8671-39e955e2e555 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:43.423569 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-91eebc23-d23f-46d4-a851-fe4244983756 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:43.431860 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-91eebc23-d23f-46d4-a851-fe4244983756 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20" status: 200 len: 1321 microversion: 2.1 time: 0.228900 Apr 08 02:45:43.432388 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 75/148] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:43 2022] GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20 => generated 1321 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:43.552588 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-6ccf7a38-6a1d-4aae-8487-886ea6b96bc1 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:43.553431 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-6ccf7a38-6a1d-4aae-8487-886ea6b96bc1 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 09e6abc6-19f4-4355-8309-fb3279d9b5e3] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:43.561957 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-6ccf7a38-6a1d-4aae-8487-886ea6b96bc1 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:43.562633 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-6ccf7a38-6a1d-4aae-8487-886ea6b96bc1 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:43.563642 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-6ccf7a38-6a1d-4aae-8487-886ea6b96bc1 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:43.564224 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-6ccf7a38-6a1d-4aae-8487-886ea6b96bc1 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:43.619053 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-c71c34ce-0c00-43ed-8671-39e955e2e555 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:43.646514 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-c71c34ce-0c00-43ed-8671-39e955e2e555 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:43.653394 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-c71c34ce-0c00-43ed-8671-39e955e2e555 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:43.654909 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-c71c34ce-0c00-43ed-8671-39e955e2e555 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1407 microversion: 2.20 time: 0.263129 Apr 08 02:45:43.655946 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 74/149] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:45:43 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1407 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 02:45:43.816762 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-6ccf7a38-6a1d-4aae-8487-886ea6b96bc1 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68bc45984974d6da1c9151c21dae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbf5bb7e51d4d2d8594d6d1d3a797a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:43.825053 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-6ccf7a38-6a1d-4aae-8487-886ea6b96bc1 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3" status: 200 len: 1365 microversion: 2.1 time: 0.282669 Apr 08 02:45:43.826213 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 76/150] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:43 2022] GET /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3 => generated 1365 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:45:44.453996 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-c2682629-f5d7-4c1f-a328-28d86db0a215 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:44.455420 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-c2682629-f5d7-4c1f-a328-28d86db0a215 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 6228b11f-244d-4e25-8b1f-e19a90cc8c20] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:44.463601 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c2682629-f5d7-4c1f-a328-28d86db0a215 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:44.464361 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c2682629-f5d7-4c1f-a328-28d86db0a215 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:44.465040 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c2682629-f5d7-4c1f-a328-28d86db0a215 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:44.465526 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c2682629-f5d7-4c1f-a328-28d86db0a215 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:44.681949 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-98fc54bc-8329-4d8a-b7b5-7d020d5407ed tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:44.683186 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-98fc54bc-8329-4d8a-b7b5-7d020d5407ed tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:44.695514 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-98fc54bc-8329-4d8a-b7b5-7d020d5407ed tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:44.695666 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-c2682629-f5d7-4c1f-a328-28d86db0a215 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:44.696271 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-98fc54bc-8329-4d8a-b7b5-7d020d5407ed tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:44.697073 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-98fc54bc-8329-4d8a-b7b5-7d020d5407ed tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:44.697503 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-98fc54bc-8329-4d8a-b7b5-7d020d5407ed tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:44.704335 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-c2682629-f5d7-4c1f-a328-28d86db0a215 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20" status: 200 len: 1321 microversion: 2.1 time: 0.259157 Apr 08 02:45:44.704873 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 75/151] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:44 2022] GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20 => generated 1321 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:44.853146 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-bccb8e50-d403-48e2-81f1-422694db658d tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:44.853899 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-bccb8e50-d403-48e2-81f1-422694db658d tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 09e6abc6-19f4-4355-8309-fb3279d9b5e3] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:44.877083 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-bccb8e50-d403-48e2-81f1-422694db658d tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:44.877909 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-bccb8e50-d403-48e2-81f1-422694db658d tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:44.879869 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-bccb8e50-d403-48e2-81f1-422694db658d tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:44.880566 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-bccb8e50-d403-48e2-81f1-422694db658d tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:44.947077 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-98fc54bc-8329-4d8a-b7b5-7d020d5407ed tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:44.980319 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-98fc54bc-8329-4d8a-b7b5-7d020d5407ed tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:44.994637 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-98fc54bc-8329-4d8a-b7b5-7d020d5407ed tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:44.995761 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-98fc54bc-8329-4d8a-b7b5-7d020d5407ed tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1407 microversion: 2.20 time: 0.325899 Apr 08 02:45:44.996287 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 77/152] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:45:44 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1407 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:45:45.179886 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-bccb8e50-d403-48e2-81f1-422694db658d tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68bc45984974d6da1c9151c21dae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbf5bb7e51d4d2d8594d6d1d3a797a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:45.188941 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-bccb8e50-d403-48e2-81f1-422694db658d tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3" status: 200 len: 1365 microversion: 2.1 time: 0.349649 Apr 08 02:45:45.189705 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 76/153] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:44 2022] GET /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3 => generated 1365 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:45:45.730457 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-469eb488-4fdb-428a-af81-08e0b843a9e3 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:45.740414 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-469eb488-4fdb-428a-af81-08e0b843a9e3 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 6228b11f-244d-4e25-8b1f-e19a90cc8c20] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:45.749570 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-469eb488-4fdb-428a-af81-08e0b843a9e3 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:45.750242 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-469eb488-4fdb-428a-af81-08e0b843a9e3 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:45.751248 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-469eb488-4fdb-428a-af81-08e0b843a9e3 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:45.751823 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-469eb488-4fdb-428a-af81-08e0b843a9e3 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:46.000071 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-469eb488-4fdb-428a-af81-08e0b843a9e3 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:46.010007 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-469eb488-4fdb-428a-af81-08e0b843a9e3 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20" status: 200 len: 1321 microversion: 2.1 time: 0.290241 Apr 08 02:45:46.011917 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 78/154] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:45 2022] GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20 => generated 1321 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:46.029814 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-4f808110-8f10-47ea-9c9e-495eeeb7ba1b tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:46.030511 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-4f808110-8f10-47ea-9c9e-495eeeb7ba1b tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:46.038564 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-4f808110-8f10-47ea-9c9e-495eeeb7ba1b tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:46.039103 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-4f808110-8f10-47ea-9c9e-495eeeb7ba1b tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:46.039936 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-4f808110-8f10-47ea-9c9e-495eeeb7ba1b tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:46.040427 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-4f808110-8f10-47ea-9c9e-495eeeb7ba1b tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:46.200110 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-98060e81-be2d-4f53-ba09-817e7dee0c36 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:46.200766 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-98060e81-be2d-4f53-ba09-817e7dee0c36 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] [instance: 2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:46.208971 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-98060e81-be2d-4f53-ba09-817e7dee0c36 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:46.209408 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-98060e81-be2d-4f53-ba09-817e7dee0c36 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:46.210170 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-98060e81-be2d-4f53-ba09-817e7dee0c36 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:46.210590 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-98060e81-be2d-4f53-ba09-817e7dee0c36 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:46.252710 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-4f808110-8f10-47ea-9c9e-495eeeb7ba1b tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:46.267735 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-4f808110-8f10-47ea-9c9e-495eeeb7ba1b tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:46.273940 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-4f808110-8f10-47ea-9c9e-495eeeb7ba1b tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:46.275029 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-4f808110-8f10-47ea-9c9e-495eeeb7ba1b tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1407 microversion: 2.20 time: 0.265465 Apr 08 02:45:46.275551 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 77/155] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:45:46 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1407 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:45:46.286181 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-b8cb3532-c7b1-4609-9ae5-9fbb6038f269 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:46.286812 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-b8cb3532-c7b1-4609-9ae5-9fbb6038f269 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 09e6abc6-19f4-4355-8309-fb3279d9b5e3] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:46.289450 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-98060e81-be2d-4f53-ba09-817e7dee0c36 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] [instance: 2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9] Going to try to terminate instance {{(pid=96919) delete /opt/stack/nova/nova/compute/api.py:2559}} Apr 08 02:45:46.293899 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b8cb3532-c7b1-4609-9ae5-9fbb6038f269 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:46.294336 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b8cb3532-c7b1-4609-9ae5-9fbb6038f269 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:46.295345 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b8cb3532-c7b1-4609-9ae5-9fbb6038f269 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:46.295769 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b8cb3532-c7b1-4609-9ae5-9fbb6038f269 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:46.413059 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-98060e81-be2d-4f53-ba09-817e7dee0c36 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] 10.222.0.48 "DELETE /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9" status: 204 len: 0 microversion: 2.1 time: 0.221926 Apr 08 02:45:46.413646 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 79/156] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Apr 8 02:45:46 2022] DELETE /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 08 02:45:46.428455 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-ba242ea4-4eb5-444a-9236-876ff9f8c1d5 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:46.429145 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-ba242ea4-4eb5-444a-9236-876ff9f8c1d5 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] [instance: 2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:46.436455 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ba242ea4-4eb5-444a-9236-876ff9f8c1d5 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:46.436896 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ba242ea4-4eb5-444a-9236-876ff9f8c1d5 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:46.437657 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ba242ea4-4eb5-444a-9236-876ff9f8c1d5 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:46.438088 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ba242ea4-4eb5-444a-9236-876ff9f8c1d5 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:46.504146 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-b8cb3532-c7b1-4609-9ae5-9fbb6038f269 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68bc45984974d6da1c9151c21dae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbf5bb7e51d4d2d8594d6d1d3a797a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:46.512714 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-b8cb3532-c7b1-4609-9ae5-9fbb6038f269 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3" status: 200 len: 1365 microversion: 2.1 time: 0.236056 Apr 08 02:45:46.513265 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 78/157] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:46 2022] GET /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3 => generated 1365 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:46.642030 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-ba242ea4-4eb5-444a-9236-876ff9f8c1d5 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246bad06441497e9fd542cc1c84da0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ab2bde6dca4830a67ca00d0223b3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:46.650607 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-ba242ea4-4eb5-444a-9236-876ff9f8c1d5 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] 10.222.0.48 "GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9" status: 200 len: 1554 microversion: 2.1 time: 0.232755 Apr 08 02:45:46.651370 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 80/158] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:46 2022] GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9 => generated 1554 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:45:47.038004 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-38eb1334-0773-43f8-a77b-de88983d3248 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:47.038789 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-38eb1334-0773-43f8-a77b-de88983d3248 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 6228b11f-244d-4e25-8b1f-e19a90cc8c20] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:47.046041 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-38eb1334-0773-43f8-a77b-de88983d3248 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:47.046547 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-38eb1334-0773-43f8-a77b-de88983d3248 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:47.047408 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-38eb1334-0773-43f8-a77b-de88983d3248 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:47.047903 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-38eb1334-0773-43f8-a77b-de88983d3248 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:47.258425 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-38eb1334-0773-43f8-a77b-de88983d3248 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:47.266722 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-38eb1334-0773-43f8-a77b-de88983d3248 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20" status: 200 len: 1515 microversion: 2.1 time: 0.241830 Apr 08 02:45:47.267253 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 79/159] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:47 2022] GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20 => generated 1515 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:47.290066 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-47db45c2-cdc3-434d-8e1f-b5511c637845 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:45:47.291091 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-47db45c2-cdc3-434d-8e1f-b5511c637845 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 6228b11f-244d-4e25-8b1f-e19a90cc8c20] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:47.298051 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-3211120b-6a9e-4f19-a0a2-08d77960a4ce tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:47.298249 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-47db45c2-cdc3-434d-8e1f-b5511c637845 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:47.298648 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-3211120b-6a9e-4f19-a0a2-08d77960a4ce tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:47.298780 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-47db45c2-cdc3-434d-8e1f-b5511c637845 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:47.299462 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-47db45c2-cdc3-434d-8e1f-b5511c637845 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:47.300537 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-47db45c2-cdc3-434d-8e1f-b5511c637845 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:47.306446 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-3211120b-6a9e-4f19-a0a2-08d77960a4ce tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:47.306926 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-3211120b-6a9e-4f19-a0a2-08d77960a4ce tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:47.307684 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-3211120b-6a9e-4f19-a0a2-08d77960a4ce tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:47.308109 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-3211120b-6a9e-4f19-a0a2-08d77960a4ce tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:47.360811 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.objects.instance [None req-47db45c2-cdc3-434d-8e1f-b5511c637845 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lazy-loading 'flavor' on Instance uuid 6228b11f-244d-4e25-8b1f-e19a90cc8c20 {{(pid=96919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 08 02:45:47.507999 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-47db45c2-cdc3-434d-8e1f-b5511c637845 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "POST /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20/action" status: 200 len: 32 microversion: 2.1 time: 0.227898 Apr 08 02:45:47.508593 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 81/160] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Apr 8 02:45:47 2022] POST /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20/action => generated 32 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 08 02:45:47.513524 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-3211120b-6a9e-4f19-a0a2-08d77960a4ce tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:47.524183 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-2f8c8276-e8dd-4d48-9f47-973d3503d84a tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:47.524683 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-2f8c8276-e8dd-4d48-9f47-973d3503d84a tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 6228b11f-244d-4e25-8b1f-e19a90cc8c20] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:47.527923 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-3211120b-6a9e-4f19-a0a2-08d77960a4ce tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:47.531915 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-2f8c8276-e8dd-4d48-9f47-973d3503d84a tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:47.532356 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-2f8c8276-e8dd-4d48-9f47-973d3503d84a tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:47.533116 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-2f8c8276-e8dd-4d48-9f47-973d3503d84a tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:47.533547 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-2f8c8276-e8dd-4d48-9f47-973d3503d84a tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:47.533897 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-3211120b-6a9e-4f19-a0a2-08d77960a4ce tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:47.535191 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-3211120b-6a9e-4f19-a0a2-08d77960a4ce tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1600 microversion: 2.20 time: 0.246157 Apr 08 02:45:47.535713 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 80/161] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:45:47 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1600 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 02:45:47.545270 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-3e8289ff-d5f2-453d-a2a1-3579eabf04c2 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:47.545857 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-3e8289ff-d5f2-453d-a2a1-3579eabf04c2 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 09e6abc6-19f4-4355-8309-fb3279d9b5e3] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:47.553994 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-3e8289ff-d5f2-453d-a2a1-3579eabf04c2 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:47.554431 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-3e8289ff-d5f2-453d-a2a1-3579eabf04c2 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:47.555218 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-3e8289ff-d5f2-453d-a2a1-3579eabf04c2 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:47.555638 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-3e8289ff-d5f2-453d-a2a1-3579eabf04c2 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:47.861213 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-2f8c8276-e8dd-4d48-9f47-973d3503d84a tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:47.866008 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-3e8289ff-d5f2-453d-a2a1-3579eabf04c2 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68bc45984974d6da1c9151c21dae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbf5bb7e51d4d2d8594d6d1d3a797a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:47.869952 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-2f8c8276-e8dd-4d48-9f47-973d3503d84a tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20" status: 200 len: 1521 microversion: 2.1 time: 0.356126 Apr 08 02:45:47.870582 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 82/162] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:47 2022] GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20 => generated 1521 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:45:47.874550 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-3e8289ff-d5f2-453d-a2a1-3579eabf04c2 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3" status: 200 len: 1365 microversion: 2.1 time: 0.337856 Apr 08 02:45:47.884287 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 81/163] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:47 2022] GET /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3 => generated 1365 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:47.885749 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-10e7c474-1aa6-4d31-bc6f-ed9ed9d288d7 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:47.886250 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-c6b5433a-aa66-4e5d-8b41-7f8027ae0233 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:47.886760 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-c6b5433a-aa66-4e5d-8b41-7f8027ae0233 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:47.887307 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-10e7c474-1aa6-4d31-bc6f-ed9ed9d288d7 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] [instance: 2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:47.894511 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-c6b5433a-aa66-4e5d-8b41-7f8027ae0233 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:47.894782 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-10e7c474-1aa6-4d31-bc6f-ed9ed9d288d7 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:47.894888 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-c6b5433a-aa66-4e5d-8b41-7f8027ae0233 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:47.895356 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-10e7c474-1aa6-4d31-bc6f-ed9ed9d288d7 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:47.895625 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-c6b5433a-aa66-4e5d-8b41-7f8027ae0233 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:47.896042 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-c6b5433a-aa66-4e5d-8b41-7f8027ae0233 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:47.896343 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-10e7c474-1aa6-4d31-bc6f-ed9ed9d288d7 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:47.896839 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-10e7c474-1aa6-4d31-bc6f-ed9ed9d288d7 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:48.101505 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-c6b5433a-aa66-4e5d-8b41-7f8027ae0233 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.228985 Apr 08 02:45:48.102284 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 83/164] 10.222.0.48 () {60 vars in 1315 bytes} [Fri Apr 8 02:45:47 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf/os-interface => generated 285 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 02:45:48.337820 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-10e7c474-1aa6-4d31-bc6f-ed9ed9d288d7 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246bad06441497e9fd542cc1c84da0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ab2bde6dca4830a67ca00d0223b3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:48.347388 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-10e7c474-1aa6-4d31-bc6f-ed9ed9d288d7 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] 10.222.0.48 "GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9" status: 200 len: 1554 microversion: 2.1 time: 0.470161 Apr 08 02:45:48.348002 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 82/165] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:47 2022] GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9 => generated 1554 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:48.892710 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-f326f4df-91ce-475f-a746-0c4e97fe6460 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:48.893371 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-f326f4df-91ce-475f-a746-0c4e97fe6460 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 6228b11f-244d-4e25-8b1f-e19a90cc8c20] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:48.897240 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-d9c07f04-e416-4498-b4eb-402f19ebda7a tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:48.897837 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-d9c07f04-e416-4498-b4eb-402f19ebda7a tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 09e6abc6-19f4-4355-8309-fb3279d9b5e3] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:48.901126 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-f326f4df-91ce-475f-a746-0c4e97fe6460 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:48.901572 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-f326f4df-91ce-475f-a746-0c4e97fe6460 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:48.902346 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-f326f4df-91ce-475f-a746-0c4e97fe6460 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:48.902802 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-f326f4df-91ce-475f-a746-0c4e97fe6460 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:48.905184 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-d9c07f04-e416-4498-b4eb-402f19ebda7a tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:48.905570 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-d9c07f04-e416-4498-b4eb-402f19ebda7a tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:48.906327 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-d9c07f04-e416-4498-b4eb-402f19ebda7a tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:48.906773 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-d9c07f04-e416-4498-b4eb-402f19ebda7a tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:49.403262 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-d9c07f04-e416-4498-b4eb-402f19ebda7a tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68bc45984974d6da1c9151c21dae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbf5bb7e51d4d2d8594d6d1d3a797a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:49.413566 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-d9c07f04-e416-4498-b4eb-402f19ebda7a tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3" status: 200 len: 1365 microversion: 2.1 time: 0.525558 Apr 08 02:45:49.414916 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 83/166] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:48 2022] GET /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3 => generated 1365 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:49.424089 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-f326f4df-91ce-475f-a746-0c4e97fe6460 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:49.430547 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-a741830f-16d1-48ec-b2a3-c6dfe6e65f14 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:49.431938 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-a741830f-16d1-48ec-b2a3-c6dfe6e65f14 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] [instance: 2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:49.437305 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-f326f4df-91ce-475f-a746-0c4e97fe6460 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20" status: 200 len: 1521 microversion: 2.1 time: 0.554208 Apr 08 02:45:49.439391 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 84/167] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:48 2022] GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20 => generated 1521 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:49.439525 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-a741830f-16d1-48ec-b2a3-c6dfe6e65f14 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:49.439747 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-a741830f-16d1-48ec-b2a3-c6dfe6e65f14 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:49.440561 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-a741830f-16d1-48ec-b2a3-c6dfe6e65f14 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:49.441169 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-a741830f-16d1-48ec-b2a3-c6dfe6e65f14 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:49.712665 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-a741830f-16d1-48ec-b2a3-c6dfe6e65f14 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246bad06441497e9fd542cc1c84da0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ab2bde6dca4830a67ca00d0223b3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:49.721310 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-a741830f-16d1-48ec-b2a3-c6dfe6e65f14 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] 10.222.0.48 "GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9" status: 200 len: 1554 microversion: 2.1 time: 0.305398 Apr 08 02:45:49.722505 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 84/168] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:49 2022] GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9 => generated 1554 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:50.193086 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [req-50e42063-8682-4efa-9ace-817017ded593 req-d6e967d5-311a-45ee-a561-d85191e4e2c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e44bc1d2-0741-4081-9165-b0aca9008eaf", "tag": "e1447a33-5dc8-44ca-8978-a2f1cdaaab34"}]} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:45:50.199222 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:45:50.199222 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: warnings.warn(msg) Apr 08 02:45:50.207327 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-50e42063-8682-4efa-9ace-817017ded593 req-d6e967d5-311a-45ee-a561-d85191e4e2c0 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:50.207763 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-50e42063-8682-4efa-9ace-817017ded593 req-d6e967d5-311a-45ee-a561-d85191e4e2c0 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:50.223708 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.compute.server_external_events [req-50e42063-8682-4efa-9ace-817017ded593 req-d6e967d5-311a-45ee-a561-d85191e4e2c0 service nova] Creating event network-changed:e1447a33-5dc8-44ca-8978-a2f1cdaaab34 for instance e44bc1d2-0741-4081-9165-b0aca9008eaf on hv-cinder-83705 Apr 08 02:45:50.228306 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [req-50e42063-8682-4efa-9ace-817017ded593 req-d6e967d5-311a-45ee-a561-d85191e4e2c0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044595 Apr 08 02:45:50.229065 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 85/169] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:45:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:45:50.436639 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-16fec61b-2df9-4d8f-a85f-def2459315df tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:50.437178 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-16fec61b-2df9-4d8f-a85f-def2459315df tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 09e6abc6-19f4-4355-8309-fb3279d9b5e3] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:50.444355 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-16fec61b-2df9-4d8f-a85f-def2459315df tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:50.444788 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-16fec61b-2df9-4d8f-a85f-def2459315df tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:50.445555 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-16fec61b-2df9-4d8f-a85f-def2459315df tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:50.445968 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-16fec61b-2df9-4d8f-a85f-def2459315df tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:50.465268 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-50074160-c197-4d83-ac4a-5285dac1267a tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:50.466242 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-50074160-c197-4d83-ac4a-5285dac1267a tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 6228b11f-244d-4e25-8b1f-e19a90cc8c20] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:50.476512 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-50074160-c197-4d83-ac4a-5285dac1267a tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:50.478715 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-50074160-c197-4d83-ac4a-5285dac1267a tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:50.480090 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-50074160-c197-4d83-ac4a-5285dac1267a tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:50.481278 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-50074160-c197-4d83-ac4a-5285dac1267a tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:50.758357 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-16fec61b-2df9-4d8f-a85f-def2459315df tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68bc45984974d6da1c9151c21dae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbf5bb7e51d4d2d8594d6d1d3a797a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:50.765836 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-50074160-c197-4d83-ac4a-5285dac1267a tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:50.767030 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-16fec61b-2df9-4d8f-a85f-def2459315df tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3" status: 200 len: 1365 microversion: 2.1 time: 0.339167 Apr 08 02:45:50.771592 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 85/170] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:50 2022] GET /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3 => generated 1365 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:50.787756 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-50074160-c197-4d83-ac4a-5285dac1267a tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20" status: 200 len: 1521 microversion: 2.1 time: 0.334813 Apr 08 02:45:50.789329 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 86/171] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:50 2022] GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20 => generated 1521 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:50.812217 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-dca769ee-0c4c-4985-b4bf-b753b31983fc tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:50.812825 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-dca769ee-0c4c-4985-b4bf-b753b31983fc tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] [instance: 2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:50.828694 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-dca769ee-0c4c-4985-b4bf-b753b31983fc tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:50.829135 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-dca769ee-0c4c-4985-b4bf-b753b31983fc tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:50.830148 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-dca769ee-0c4c-4985-b4bf-b753b31983fc tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:50.830578 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-dca769ee-0c4c-4985-b4bf-b753b31983fc tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:51.058282 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-dca769ee-0c4c-4985-b4bf-b753b31983fc tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246bad06441497e9fd542cc1c84da0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ab2bde6dca4830a67ca00d0223b3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:51.067236 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-dca769ee-0c4c-4985-b4bf-b753b31983fc tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] 10.222.0.48 "GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9" status: 200 len: 1554 microversion: 2.1 time: 0.294596 Apr 08 02:45:51.067776 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 86/172] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:50 2022] GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9 => generated 1554 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:51.797303 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-787b8e50-294d-4854-ab1a-91177e8738b4 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:51.797943 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-787b8e50-294d-4854-ab1a-91177e8738b4 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 09e6abc6-19f4-4355-8309-fb3279d9b5e3] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:51.813143 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-4bbb7313-2975-4297-8ee2-42b82a5d7e5b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:51.813810 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-4bbb7313-2975-4297-8ee2-42b82a5d7e5b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 6228b11f-244d-4e25-8b1f-e19a90cc8c20] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:51.821188 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-787b8e50-294d-4854-ab1a-91177e8738b4 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:51.821626 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-787b8e50-294d-4854-ab1a-91177e8738b4 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:51.822397 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-787b8e50-294d-4854-ab1a-91177e8738b4 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:51.822851 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-787b8e50-294d-4854-ab1a-91177e8738b4 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:51.829914 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-4bbb7313-2975-4297-8ee2-42b82a5d7e5b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:51.830632 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-4bbb7313-2975-4297-8ee2-42b82a5d7e5b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:51.831313 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-4bbb7313-2975-4297-8ee2-42b82a5d7e5b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:51.831745 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-4bbb7313-2975-4297-8ee2-42b82a5d7e5b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:52.205061 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-4bbb7313-2975-4297-8ee2-42b82a5d7e5b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:52.208708 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-787b8e50-294d-4854-ab1a-91177e8738b4 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68bc45984974d6da1c9151c21dae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbf5bb7e51d4d2d8594d6d1d3a797a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:52.213239 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-4bbb7313-2975-4297-8ee2-42b82a5d7e5b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20" status: 200 len: 1521 microversion: 2.1 time: 0.411116 Apr 08 02:45:52.215201 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 87/173] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:51 2022] GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20 => generated 1521 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:52.225357 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-8f8cccf8-99a0-4d9b-b228-d6a1ae120503 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:52.225946 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-8f8cccf8-99a0-4d9b-b228-d6a1ae120503 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] [instance: 2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:52.226099 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-787b8e50-294d-4854-ab1a-91177e8738b4 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3" status: 200 len: 1555 microversion: 2.1 time: 0.437988 Apr 08 02:45:52.226648 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 87/174] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:51 2022] GET /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3 => generated 1555 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:52.233207 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-8f8cccf8-99a0-4d9b-b228-d6a1ae120503 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:52.233639 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-8f8cccf8-99a0-4d9b-b228-d6a1ae120503 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:52.234395 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-8f8cccf8-99a0-4d9b-b228-d6a1ae120503 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:52.234850 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-8f8cccf8-99a0-4d9b-b228-d6a1ae120503 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:52.248520 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-0032df26-9632-4c62-bb9b-3fc83240deb3 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:52.249117 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-0032df26-9632-4c62-bb9b-3fc83240deb3 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 09e6abc6-19f4-4355-8309-fb3279d9b5e3] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:52.256676 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-0032df26-9632-4c62-bb9b-3fc83240deb3 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:52.257122 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-0032df26-9632-4c62-bb9b-3fc83240deb3 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:52.257888 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-0032df26-9632-4c62-bb9b-3fc83240deb3 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:52.258325 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-0032df26-9632-4c62-bb9b-3fc83240deb3 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:52.452617 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-8f8cccf8-99a0-4d9b-b228-d6a1ae120503 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246bad06441497e9fd542cc1c84da0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ab2bde6dca4830a67ca00d0223b3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:52.461510 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-8f8cccf8-99a0-4d9b-b228-d6a1ae120503 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] 10.222.0.48 "GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9" status: 200 len: 1554 microversion: 2.1 time: 0.245281 Apr 08 02:45:52.462039 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 88/175] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:52 2022] GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9 => generated 1554 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:52.544226 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-0032df26-9632-4c62-bb9b-3fc83240deb3 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.304558 Apr 08 02:45:52.544816 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 88/176] 10.222.0.48 () {58 vars in 1274 bytes} [Fri Apr 8 02:45:52 2022] GET /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3/os-interface => generated 285 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:45:53.237381 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-4d022aa8-dfd0-4255-8373-d3c698b7dd35 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:53.238560 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-4d022aa8-dfd0-4255-8373-d3c698b7dd35 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 6228b11f-244d-4e25-8b1f-e19a90cc8c20] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:53.245838 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-4d022aa8-dfd0-4255-8373-d3c698b7dd35 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:53.246400 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-4d022aa8-dfd0-4255-8373-d3c698b7dd35 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:53.247213 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-4d022aa8-dfd0-4255-8373-d3c698b7dd35 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:53.247638 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-4d022aa8-dfd0-4255-8373-d3c698b7dd35 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:53.483848 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-f43968f1-05ef-418a-a49e-f6eb4678f4bd tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:53.484423 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-f43968f1-05ef-418a-a49e-f6eb4678f4bd tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] [instance: 2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:53.492523 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-f43968f1-05ef-418a-a49e-f6eb4678f4bd tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:53.492966 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-f43968f1-05ef-418a-a49e-f6eb4678f4bd tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:53.493736 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-f43968f1-05ef-418a-a49e-f6eb4678f4bd tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:53.494169 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-f43968f1-05ef-418a-a49e-f6eb4678f4bd tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:53.578368 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-4d022aa8-dfd0-4255-8373-d3c698b7dd35 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:53.586615 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-4d022aa8-dfd0-4255-8373-d3c698b7dd35 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20" status: 200 len: 1521 microversion: 2.1 time: 0.358523 Apr 08 02:45:53.587308 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 89/177] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:53 2022] GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20 => generated 1521 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:53.926413 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-f43968f1-05ef-418a-a49e-f6eb4678f4bd tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246bad06441497e9fd542cc1c84da0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ab2bde6dca4830a67ca00d0223b3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:53.934862 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-f43968f1-05ef-418a-a49e-f6eb4678f4bd tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] 10.222.0.48 "GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9" status: 200 len: 1554 microversion: 2.1 time: 0.460293 Apr 08 02:45:53.935397 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 89/178] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:53 2022] GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9 => generated 1554 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:45:54.426038 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [req-473bfdbf-b92f-46d9-900f-4fafdef64511 req-b20bab35-b70a-4945-97ba-233c56e2cdca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09e6abc6-19f4-4355-8309-fb3279d9b5e3", "tag": "b5e78270-c26b-4b02-a6c8-efffc69a4c3c"}]} {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:45:54.432242 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:45:54.432242 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: warnings.warn(msg) Apr 08 02:45:54.440388 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-473bfdbf-b92f-46d9-900f-4fafdef64511 req-b20bab35-b70a-4945-97ba-233c56e2cdca service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:54.440871 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-473bfdbf-b92f-46d9-900f-4fafdef64511 req-b20bab35-b70a-4945-97ba-233c56e2cdca service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:54.463952 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.compute.server_external_events [req-473bfdbf-b92f-46d9-900f-4fafdef64511 req-b20bab35-b70a-4945-97ba-233c56e2cdca service nova] Creating event network-changed:b5e78270-c26b-4b02-a6c8-efffc69a4c3c for instance 09e6abc6-19f4-4355-8309-fb3279d9b5e3 on hv-cinder-83705 Apr 08 02:45:54.468905 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [req-473bfdbf-b92f-46d9-900f-4fafdef64511 req-b20bab35-b70a-4945-97ba-233c56e2cdca service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051639 Apr 08 02:45:54.469483 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 90/179] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:45:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:45:54.608974 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-3fb9c435-db87-45c3-bc55-c83b8162f338 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:54.609527 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-3fb9c435-db87-45c3-bc55-c83b8162f338 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 6228b11f-244d-4e25-8b1f-e19a90cc8c20] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:54.617222 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-3fb9c435-db87-45c3-bc55-c83b8162f338 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:54.617660 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-3fb9c435-db87-45c3-bc55-c83b8162f338 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:54.618436 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-3fb9c435-db87-45c3-bc55-c83b8162f338 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:54.618892 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-3fb9c435-db87-45c3-bc55-c83b8162f338 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:54.821506 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-3fb9c435-db87-45c3-bc55-c83b8162f338 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:54.829508 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-3fb9c435-db87-45c3-bc55-c83b8162f338 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20" status: 200 len: 1521 microversion: 2.1 time: 0.229713 Apr 08 02:45:54.830120 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 90/180] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:54 2022] GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20 => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:54.958596 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-ffa8855b-f26f-4805-92fd-a1879ebab73b tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:54.959373 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-ffa8855b-f26f-4805-92fd-a1879ebab73b tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] [instance: 2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:54.967734 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-ffa8855b-f26f-4805-92fd-a1879ebab73b tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:54.968207 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-ffa8855b-f26f-4805-92fd-a1879ebab73b tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:54.968975 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-ffa8855b-f26f-4805-92fd-a1879ebab73b tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:54.969405 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-ffa8855b-f26f-4805-92fd-a1879ebab73b tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:55.180111 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-ffa8855b-f26f-4805-92fd-a1879ebab73b tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246bad06441497e9fd542cc1c84da0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ab2bde6dca4830a67ca00d0223b3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:55.187128 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-ffa8855b-f26f-4805-92fd-a1879ebab73b tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] 10.222.0.48 "GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9" status: 200 len: 1554 microversion: 2.1 time: 0.238838 Apr 08 02:45:55.187997 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 91/181] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:54 2022] GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9 => generated 1554 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:55.852751 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-a348e16a-d848-421b-88ca-daf0929ad88c tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:55.853356 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-a348e16a-d848-421b-88ca-daf0929ad88c tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 6228b11f-244d-4e25-8b1f-e19a90cc8c20] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:55.860686 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-a348e16a-d848-421b-88ca-daf0929ad88c tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:55.861126 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-a348e16a-d848-421b-88ca-daf0929ad88c tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:55.862014 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-a348e16a-d848-421b-88ca-daf0929ad88c tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:55.862471 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-a348e16a-d848-421b-88ca-daf0929ad88c tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:56.071437 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-a348e16a-d848-421b-88ca-daf0929ad88c tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:56.080110 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-a348e16a-d848-421b-88ca-daf0929ad88c tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20" status: 200 len: 1521 microversion: 2.1 time: 0.237222 Apr 08 02:45:56.080662 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 91/182] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:55 2022] GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20 => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:56.210164 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-38251dca-423d-4572-b9ee-f100be8e0284 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:56.210860 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-38251dca-423d-4572-b9ee-f100be8e0284 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] [instance: 2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:56.222527 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-38251dca-423d-4572-b9ee-f100be8e0284 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:56.223255 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-38251dca-423d-4572-b9ee-f100be8e0284 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:56.223823 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-38251dca-423d-4572-b9ee-f100be8e0284 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:56.224211 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-38251dca-423d-4572-b9ee-f100be8e0284 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:56.424222 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-38251dca-423d-4572-b9ee-f100be8e0284 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246bad06441497e9fd542cc1c84da0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ab2bde6dca4830a67ca00d0223b3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:56.433205 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-38251dca-423d-4572-b9ee-f100be8e0284 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] 10.222.0.48 "GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9" status: 200 len: 1554 microversion: 2.1 time: 0.232840 Apr 08 02:45:56.433737 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 92/183] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:56 2022] GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9 => generated 1554 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:57.103333 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-87a4eeaf-f0b3-483b-9078-a1c06dbed0d1 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:57.103934 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-87a4eeaf-f0b3-483b-9078-a1c06dbed0d1 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 6228b11f-244d-4e25-8b1f-e19a90cc8c20] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:57.111117 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-87a4eeaf-f0b3-483b-9078-a1c06dbed0d1 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:57.111560 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-87a4eeaf-f0b3-483b-9078-a1c06dbed0d1 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:57.113106 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-87a4eeaf-f0b3-483b-9078-a1c06dbed0d1 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:57.113542 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-87a4eeaf-f0b3-483b-9078-a1c06dbed0d1 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:57.323008 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-87a4eeaf-f0b3-483b-9078-a1c06dbed0d1 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:57.331653 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-87a4eeaf-f0b3-483b-9078-a1c06dbed0d1 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20" status: 200 len: 1521 microversion: 2.1 time: 0.237013 Apr 08 02:45:57.332188 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 92/184] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:57 2022] GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20 => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:57.456311 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-704a9432-2c03-496c-a62a-c0189cca6e2c tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:57.456928 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-704a9432-2c03-496c-a62a-c0189cca6e2c tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] [instance: 2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:57.463988 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-704a9432-2c03-496c-a62a-c0189cca6e2c tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:57.464429 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-704a9432-2c03-496c-a62a-c0189cca6e2c tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:57.465192 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-704a9432-2c03-496c-a62a-c0189cca6e2c tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:57.465620 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-704a9432-2c03-496c-a62a-c0189cca6e2c tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:57.676045 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-704a9432-2c03-496c-a62a-c0189cca6e2c tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246bad06441497e9fd542cc1c84da0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ab2bde6dca4830a67ca00d0223b3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:57.685154 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-704a9432-2c03-496c-a62a-c0189cca6e2c tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] 10.222.0.48 "GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9" status: 200 len: 1554 microversion: 2.1 time: 0.237732 Apr 08 02:45:57.685964 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 93/185] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:57 2022] GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9 => generated 1554 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:58.353801 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-b591a9b9-f529-4702-afe3-edcfc1517ba2 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:58.354395 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-b591a9b9-f529-4702-afe3-edcfc1517ba2 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 6228b11f-244d-4e25-8b1f-e19a90cc8c20] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:58.361388 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b591a9b9-f529-4702-afe3-edcfc1517ba2 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:58.361875 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b591a9b9-f529-4702-afe3-edcfc1517ba2 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:58.362628 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b591a9b9-f529-4702-afe3-edcfc1517ba2 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:58.363071 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b591a9b9-f529-4702-afe3-edcfc1517ba2 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:58.563637 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-b591a9b9-f529-4702-afe3-edcfc1517ba2 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:58.571740 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-b591a9b9-f529-4702-afe3-edcfc1517ba2 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20" status: 200 len: 1521 microversion: 2.1 time: 0.227207 Apr 08 02:45:58.572261 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 93/186] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:58 2022] GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20 => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:58.708044 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-b69d392f-a51c-438b-b824-30e782bed70d tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:58.708638 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-b69d392f-a51c-438b-b824-30e782bed70d tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] [instance: 2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:58.715807 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b69d392f-a51c-438b-b824-30e782bed70d tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:58.716248 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b69d392f-a51c-438b-b824-30e782bed70d tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:58.717220 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b69d392f-a51c-438b-b824-30e782bed70d tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:58.717457 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b69d392f-a51c-438b-b824-30e782bed70d tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:58.915986 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-b69d392f-a51c-438b-b824-30e782bed70d tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246bad06441497e9fd542cc1c84da0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ab2bde6dca4830a67ca00d0223b3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:58.924455 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-b69d392f-a51c-438b-b824-30e782bed70d tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] 10.222.0.48 "GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9" status: 200 len: 1554 microversion: 2.1 time: 0.225734 Apr 08 02:45:58.924986 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 94/187] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:58 2022] GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9 => generated 1554 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:59.592841 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-061b958d-01eb-46e0-9e1b-702fa53a27f3 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:59.593440 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-061b958d-01eb-46e0-9e1b-702fa53a27f3 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 6228b11f-244d-4e25-8b1f-e19a90cc8c20] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:59.600686 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-061b958d-01eb-46e0-9e1b-702fa53a27f3 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:59.601129 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-061b958d-01eb-46e0-9e1b-702fa53a27f3 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:59.602215 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-061b958d-01eb-46e0-9e1b-702fa53a27f3 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:59.602657 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-061b958d-01eb-46e0-9e1b-702fa53a27f3 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:59.802999 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-061b958d-01eb-46e0-9e1b-702fa53a27f3 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:45:59.811232 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-061b958d-01eb-46e0-9e1b-702fa53a27f3 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20" status: 200 len: 1521 microversion: 2.1 time: 0.227391 Apr 08 02:45:59.811758 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 94/188] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:59 2022] GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20 => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:45:59.946352 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-5d9d5d74-121c-4707-b2ca-251dcb68d437 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:45:59.946986 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-5d9d5d74-121c-4707-b2ca-251dcb68d437 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] [instance: 2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:45:59.954204 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-5d9d5d74-121c-4707-b2ca-251dcb68d437 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:59.954653 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-5d9d5d74-121c-4707-b2ca-251dcb68d437 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:45:59.955481 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-5d9d5d74-121c-4707-b2ca-251dcb68d437 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:45:59.956414 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-5d9d5d74-121c-4707-b2ca-251dcb68d437 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:00.161024 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-5d9d5d74-121c-4707-b2ca-251dcb68d437 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246bad06441497e9fd542cc1c84da0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ab2bde6dca4830a67ca00d0223b3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:46:00.169348 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-5d9d5d74-121c-4707-b2ca-251dcb68d437 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] 10.222.0.48 "GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9" status: 200 len: 1554 microversion: 2.1 time: 0.232483 Apr 08 02:46:00.169871 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 95/189] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:45:59 2022] GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9 => generated 1554 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:00.834252 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-c2bbd934-3532-460d-b1d1-29a12865f85a tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:00.834884 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-c2bbd934-3532-460d-b1d1-29a12865f85a tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 6228b11f-244d-4e25-8b1f-e19a90cc8c20] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:46:00.841989 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-c2bbd934-3532-460d-b1d1-29a12865f85a tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:00.842430 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-c2bbd934-3532-460d-b1d1-29a12865f85a tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:00.843225 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-c2bbd934-3532-460d-b1d1-29a12865f85a tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:00.843656 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-c2bbd934-3532-460d-b1d1-29a12865f85a tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:01.042873 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-c2bbd934-3532-460d-b1d1-29a12865f85a tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:46:01.050887 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-c2bbd934-3532-460d-b1d1-29a12865f85a tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20" status: 200 len: 1521 microversion: 2.1 time: 0.226251 Apr 08 02:46:01.051423 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 95/190] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:00 2022] GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20 => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:01.191113 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-55b46a4c-14d8-45c3-b5eb-53201660b285 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:01.191714 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-55b46a4c-14d8-45c3-b5eb-53201660b285 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] [instance: 2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:46:01.199181 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-55b46a4c-14d8-45c3-b5eb-53201660b285 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:01.199618 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-55b46a4c-14d8-45c3-b5eb-53201660b285 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:01.200373 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-55b46a4c-14d8-45c3-b5eb-53201660b285 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:01.200799 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-55b46a4c-14d8-45c3-b5eb-53201660b285 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:01.483146 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-55b46a4c-14d8-45c3-b5eb-53201660b285 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246bad06441497e9fd542cc1c84da0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ab2bde6dca4830a67ca00d0223b3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:46:01.491932 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-55b46a4c-14d8-45c3-b5eb-53201660b285 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] 10.222.0.48 "GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9" status: 200 len: 1554 microversion: 2.1 time: 0.309730 Apr 08 02:46:01.492471 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 96/191] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:01 2022] GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9 => generated 1554 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:01.793279 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [req-a79729ae-cc35-453d-8dbe-c9ba831d4d59 req-11c5bde9-8870-49c1-9976-53552168d05a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9", "name": "network-vif-unplugged", "status": "completed", "tag": "44289cfd-1a39-4ed4-8b1c-43f7bf303706"}]} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:46:01.800480 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:46:01.800480 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: warnings.warn(msg) Apr 08 02:46:01.811192 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-a79729ae-cc35-453d-8dbe-c9ba831d4d59 req-11c5bde9-8870-49c1-9976-53552168d05a service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:01.811635 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-a79729ae-cc35-453d-8dbe-c9ba831d4d59 req-11c5bde9-8870-49c1-9976-53552168d05a service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:01.829112 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.compute.server_external_events [req-a79729ae-cc35-453d-8dbe-c9ba831d4d59 req-11c5bde9-8870-49c1-9976-53552168d05a service nova] Creating event network-vif-unplugged:44289cfd-1a39-4ed4-8b1c-43f7bf303706 for instance 2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9 on hv-cinder-83705 Apr 08 02:46:01.836324 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [req-a79729ae-cc35-453d-8dbe-c9ba831d4d59 req-11c5bde9-8870-49c1-9976-53552168d05a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054479 Apr 08 02:46:01.837399 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 96/192] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:46:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:46:02.072750 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-9fa38a4d-e075-4daa-b751-a8dc8cfee48e tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:02.073407 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-9fa38a4d-e075-4daa-b751-a8dc8cfee48e tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 6228b11f-244d-4e25-8b1f-e19a90cc8c20] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:46:02.081159 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-9fa38a4d-e075-4daa-b751-a8dc8cfee48e tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:02.081604 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-9fa38a4d-e075-4daa-b751-a8dc8cfee48e tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:02.082377 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-9fa38a4d-e075-4daa-b751-a8dc8cfee48e tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:02.082857 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-9fa38a4d-e075-4daa-b751-a8dc8cfee48e tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:02.288549 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-9fa38a4d-e075-4daa-b751-a8dc8cfee48e tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:46:02.296491 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-9fa38a4d-e075-4daa-b751-a8dc8cfee48e tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20" status: 200 len: 1521 microversion: 2.1 time: 0.232941 Apr 08 02:46:02.297033 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 97/193] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:02 2022] GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20 => generated 1521 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:02.515041 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-09e3dc7c-d7f7-49d5-bc15-f97b54421374 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:02.516329 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-09e3dc7c-d7f7-49d5-bc15-f97b54421374 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] [instance: 2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:46:02.524340 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-09e3dc7c-d7f7-49d5-bc15-f97b54421374 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:02.524780 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-09e3dc7c-d7f7-49d5-bc15-f97b54421374 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:02.525542 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-09e3dc7c-d7f7-49d5-bc15-f97b54421374 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:02.525964 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-09e3dc7c-d7f7-49d5-bc15-f97b54421374 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:02.738201 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-09e3dc7c-d7f7-49d5-bc15-f97b54421374 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246bad06441497e9fd542cc1c84da0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ab2bde6dca4830a67ca00d0223b3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:46:02.747458 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-09e3dc7c-d7f7-49d5-bc15-f97b54421374 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] 10.222.0.48 "GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9" status: 200 len: 1554 microversion: 2.1 time: 0.242244 Apr 08 02:46:02.757604 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 97/194] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:02 2022] GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9 => generated 1554 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:46:03.102304 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [req-ece3e996-da82-4713-842b-c24892b938a3 req-fb14e0d7-9cb3-4c1f-b4a7-40c420c3efe3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9", "name": "network-vif-deleted", "tag": "44289cfd-1a39-4ed4-8b1c-43f7bf303706"}]} {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:46:03.118295 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:46:03.118295 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: warnings.warn(msg) Apr 08 02:46:03.128057 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-ece3e996-da82-4713-842b-c24892b938a3 req-fb14e0d7-9cb3-4c1f-b4a7-40c420c3efe3 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:03.128490 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-ece3e996-da82-4713-842b-c24892b938a3 req-fb14e0d7-9cb3-4c1f-b4a7-40c420c3efe3 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:03.145053 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.compute.server_external_events [req-ece3e996-da82-4713-842b-c24892b938a3 req-fb14e0d7-9cb3-4c1f-b4a7-40c420c3efe3 service nova] Creating event network-vif-deleted:44289cfd-1a39-4ed4-8b1c-43f7bf303706 for instance 2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9 on hv-cinder-83705 Apr 08 02:46:03.149738 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [req-ece3e996-da82-4713-842b-c24892b938a3 req-fb14e0d7-9cb3-4c1f-b4a7-40c420c3efe3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057191 Apr 08 02:46:03.150304 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 98/195] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:46:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 02:46:03.319548 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-ceb52a49-0402-488a-9955-0e23a8f1804c tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:03.320059 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-ceb52a49-0402-488a-9955-0e23a8f1804c tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 6228b11f-244d-4e25-8b1f-e19a90cc8c20] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:46:03.327186 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ceb52a49-0402-488a-9955-0e23a8f1804c tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:03.327623 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ceb52a49-0402-488a-9955-0e23a8f1804c tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:03.328378 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ceb52a49-0402-488a-9955-0e23a8f1804c tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:03.328800 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ceb52a49-0402-488a-9955-0e23a8f1804c tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:03.527688 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-ceb52a49-0402-488a-9955-0e23a8f1804c tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:46:03.536495 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-ceb52a49-0402-488a-9955-0e23a8f1804c tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20" status: 200 len: 1521 microversion: 2.1 time: 0.226521 Apr 08 02:46:03.537021 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 98/196] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:03 2022] GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20 => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:03.771528 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-57e22217-9f16-4304-aadf-c28ffd59594b tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:03.772217 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-57e22217-9f16-4304-aadf-c28ffd59594b tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] [instance: 2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:46:03.779642 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-57e22217-9f16-4304-aadf-c28ffd59594b tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:03.780080 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-57e22217-9f16-4304-aadf-c28ffd59594b tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:03.780825 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-57e22217-9f16-4304-aadf-c28ffd59594b tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:03.781253 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-57e22217-9f16-4304-aadf-c28ffd59594b tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:03.904503 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-57e22217-9f16-4304-aadf-c28ffd59594b tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246bad06441497e9fd542cc1c84da0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ab2bde6dca4830a67ca00d0223b3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:46:03.914251 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-57e22217-9f16-4304-aadf-c28ffd59594b tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] 10.222.0.48 "GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9" status: 200 len: 1512 microversion: 2.1 time: 0.153026 Apr 08 02:46:03.914805 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 99/197] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:03 2022] GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9 => generated 1512 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:04.558315 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-8e8a8328-bd7b-4b6d-b05c-9653cda1e544 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:04.558957 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-8e8a8328-bd7b-4b6d-b05c-9653cda1e544 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 6228b11f-244d-4e25-8b1f-e19a90cc8c20] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:46:04.566544 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-8e8a8328-bd7b-4b6d-b05c-9653cda1e544 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:04.567018 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-8e8a8328-bd7b-4b6d-b05c-9653cda1e544 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:04.567818 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-8e8a8328-bd7b-4b6d-b05c-9653cda1e544 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:04.568243 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-8e8a8328-bd7b-4b6d-b05c-9653cda1e544 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:04.766595 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-8e8a8328-bd7b-4b6d-b05c-9653cda1e544 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:46:04.774855 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-8e8a8328-bd7b-4b6d-b05c-9653cda1e544 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20" status: 200 len: 1521 microversion: 2.1 time: 0.225502 Apr 08 02:46:04.775325 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 99/198] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:04 2022] GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20 => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:04.936465 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-2063e4e3-6dc9-4335-96e7-e82ee8faf075 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:04.937056 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-2063e4e3-6dc9-4335-96e7-e82ee8faf075 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] [instance: 2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:46:04.944835 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-2063e4e3-6dc9-4335-96e7-e82ee8faf075 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:04.945269 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-2063e4e3-6dc9-4335-96e7-e82ee8faf075 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:04.946017 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-2063e4e3-6dc9-4335-96e7-e82ee8faf075 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:04.946439 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-2063e4e3-6dc9-4335-96e7-e82ee8faf075 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:05.072997 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-2063e4e3-6dc9-4335-96e7-e82ee8faf075 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246bad06441497e9fd542cc1c84da0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ab2bde6dca4830a67ca00d0223b3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:46:05.081347 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-2063e4e3-6dc9-4335-96e7-e82ee8faf075 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] 10.222.0.48 "GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9" status: 200 len: 1346 microversion: 2.1 time: 0.153996 Apr 08 02:46:05.081857 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 100/199] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:04 2022] GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9 => generated 1346 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:05.796547 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-aa9bbcbd-149e-4167-a343-9d3f5cbd0721 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:05.797058 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-aa9bbcbd-149e-4167-a343-9d3f5cbd0721 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 6228b11f-244d-4e25-8b1f-e19a90cc8c20] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:46:05.804338 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-aa9bbcbd-149e-4167-a343-9d3f5cbd0721 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:05.804777 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-aa9bbcbd-149e-4167-a343-9d3f5cbd0721 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:05.805545 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-aa9bbcbd-149e-4167-a343-9d3f5cbd0721 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:05.805969 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-aa9bbcbd-149e-4167-a343-9d3f5cbd0721 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:06.005773 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-aa9bbcbd-149e-4167-a343-9d3f5cbd0721 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:46:06.014388 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-aa9bbcbd-149e-4167-a343-9d3f5cbd0721 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20" status: 200 len: 1521 microversion: 2.1 time: 0.226713 Apr 08 02:46:06.014963 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 100/200] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:05 2022] GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20 => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:06.103531 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-d162aa84-3c5a-47ec-a846-2be3a23f743b tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:06.104126 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-d162aa84-3c5a-47ec-a846-2be3a23f743b tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] [instance: 2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:46:06.111327 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-d162aa84-3c5a-47ec-a846-2be3a23f743b tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:06.112388 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-d162aa84-3c5a-47ec-a846-2be3a23f743b tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:06.113142 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-d162aa84-3c5a-47ec-a846-2be3a23f743b tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:06.113565 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-d162aa84-3c5a-47ec-a846-2be3a23f743b tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:06.235626 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-d162aa84-3c5a-47ec-a846-2be3a23f743b tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246bad06441497e9fd542cc1c84da0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ab2bde6dca4830a67ca00d0223b3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:46:06.244449 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-d162aa84-3c5a-47ec-a846-2be3a23f743b tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] 10.222.0.48 "GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9" status: 200 len: 1346 microversion: 2.1 time: 0.150282 Apr 08 02:46:06.245295 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 101/201] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:06 2022] GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9 => generated 1346 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:07.037332 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-2ebebb12-1cc0-4581-97e1-fc1a2aceff44 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:07.037927 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-2ebebb12-1cc0-4581-97e1-fc1a2aceff44 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 6228b11f-244d-4e25-8b1f-e19a90cc8c20] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:46:07.044928 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-2ebebb12-1cc0-4581-97e1-fc1a2aceff44 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:07.045365 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-2ebebb12-1cc0-4581-97e1-fc1a2aceff44 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:07.046118 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-2ebebb12-1cc0-4581-97e1-fc1a2aceff44 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:07.046541 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-2ebebb12-1cc0-4581-97e1-fc1a2aceff44 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:07.249255 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-2ebebb12-1cc0-4581-97e1-fc1a2aceff44 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:46:07.258160 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-2ebebb12-1cc0-4581-97e1-fc1a2aceff44 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20" status: 200 len: 1521 microversion: 2.1 time: 0.229681 Apr 08 02:46:07.258747 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 101/202] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:07 2022] GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20 => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:07.267118 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-b075196e-6147-4856-b6d7-3d72a3579f46 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:07.268445 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-b075196e-6147-4856-b6d7-3d72a3579f46 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] [instance: 2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:46:07.275826 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b075196e-6147-4856-b6d7-3d72a3579f46 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:07.276297 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b075196e-6147-4856-b6d7-3d72a3579f46 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:07.277083 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b075196e-6147-4856-b6d7-3d72a3579f46 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:07.277674 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b075196e-6147-4856-b6d7-3d72a3579f46 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:07.403886 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-b075196e-6147-4856-b6d7-3d72a3579f46 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246bad06441497e9fd542cc1c84da0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ab2bde6dca4830a67ca00d0223b3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:46:07.412342 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-b075196e-6147-4856-b6d7-3d72a3579f46 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] 10.222.0.48 "GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9" status: 200 len: 1346 microversion: 2.1 time: 0.154741 Apr 08 02:46:07.412974 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 102/203] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:07 2022] GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9 => generated 1346 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:46:08.281126 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-3841048f-702e-4ec2-952a-28a300997bed tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:08.281672 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-3841048f-702e-4ec2-952a-28a300997bed tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 6228b11f-244d-4e25-8b1f-e19a90cc8c20] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:46:08.289352 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-3841048f-702e-4ec2-952a-28a300997bed tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:08.289795 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-3841048f-702e-4ec2-952a-28a300997bed tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:08.290552 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-3841048f-702e-4ec2-952a-28a300997bed tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:08.291017 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-3841048f-702e-4ec2-952a-28a300997bed tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:08.436670 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-2d6525e0-f4c2-4bdb-9499-0ceded80ee83 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:08.437410 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-2d6525e0-f4c2-4bdb-9499-0ceded80ee83 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] [instance: 2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:46:08.445081 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-2d6525e0-f4c2-4bdb-9499-0ceded80ee83 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:08.445617 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-2d6525e0-f4c2-4bdb-9499-0ceded80ee83 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:08.446469 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-2d6525e0-f4c2-4bdb-9499-0ceded80ee83 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:08.446993 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-2d6525e0-f4c2-4bdb-9499-0ceded80ee83 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:08.511473 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-3841048f-702e-4ec2-952a-28a300997bed tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:46:08.513554 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-3841048f-702e-4ec2-952a-28a300997bed tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20" status: 200 len: 1521 microversion: 2.1 time: 0.241427 Apr 08 02:46:08.514198 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 102/204] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:08 2022] GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20 => generated 1521 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:08.573752 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-2d6525e0-f4c2-4bdb-9499-0ceded80ee83 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246bad06441497e9fd542cc1c84da0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ab2bde6dca4830a67ca00d0223b3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:46:08.583580 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-2d6525e0-f4c2-4bdb-9499-0ceded80ee83 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] 10.222.0.48 "GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9" status: 200 len: 1346 microversion: 2.1 time: 0.157902 Apr 08 02:46:08.584296 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 103/205] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:08 2022] GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9 => generated 1346 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:09.536566 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-bb9ffe4e-a3db-4c63-95e6-b7e53c7ca68d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:09.537171 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-bb9ffe4e-a3db-4c63-95e6-b7e53c7ca68d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 6228b11f-244d-4e25-8b1f-e19a90cc8c20] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:46:09.544284 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-bb9ffe4e-a3db-4c63-95e6-b7e53c7ca68d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:09.544724 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-bb9ffe4e-a3db-4c63-95e6-b7e53c7ca68d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:09.545493 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-bb9ffe4e-a3db-4c63-95e6-b7e53c7ca68d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:09.545925 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-bb9ffe4e-a3db-4c63-95e6-b7e53c7ca68d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:09.605200 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-e44db26e-68f3-42b7-b51c-4b8b345c8f7e tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:09.605794 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-e44db26e-68f3-42b7-b51c-4b8b345c8f7e tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] [instance: 2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:46:09.613152 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-e44db26e-68f3-42b7-b51c-4b8b345c8f7e tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:09.613597 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-e44db26e-68f3-42b7-b51c-4b8b345c8f7e tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:09.614356 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-e44db26e-68f3-42b7-b51c-4b8b345c8f7e tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:09.614799 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-e44db26e-68f3-42b7-b51c-4b8b345c8f7e tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:09.748160 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-e44db26e-68f3-42b7-b51c-4b8b345c8f7e tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246bad06441497e9fd542cc1c84da0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ab2bde6dca4830a67ca00d0223b3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:46:09.756818 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-e44db26e-68f3-42b7-b51c-4b8b345c8f7e tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] 10.222.0.48 "GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9" status: 200 len: 1346 microversion: 2.1 time: 0.160576 Apr 08 02:46:09.757352 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 104/206] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:09 2022] GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9 => generated 1346 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:09.790601 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-bb9ffe4e-a3db-4c63-95e6-b7e53c7ca68d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:46:09.799813 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-bb9ffe4e-a3db-4c63-95e6-b7e53c7ca68d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20" status: 200 len: 1521 microversion: 2.1 time: 0.271698 Apr 08 02:46:09.800351 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 103/207] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:09 2022] GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20 => generated 1521 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:10.779323 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-d23ddfc9-b262-4d07-9497-72938f37bec3 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:10.779926 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-d23ddfc9-b262-4d07-9497-72938f37bec3 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] [instance: 2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:46:10.788318 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-d23ddfc9-b262-4d07-9497-72938f37bec3 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:10.788761 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-d23ddfc9-b262-4d07-9497-72938f37bec3 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:10.789528 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-d23ddfc9-b262-4d07-9497-72938f37bec3 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:10.789959 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-d23ddfc9-b262-4d07-9497-72938f37bec3 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:10.821646 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-9ba3b7cf-26e3-42f1-bffa-0230e09f00e0 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:10.822249 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-9ba3b7cf-26e3-42f1-bffa-0230e09f00e0 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 6228b11f-244d-4e25-8b1f-e19a90cc8c20] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:46:10.829291 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-9ba3b7cf-26e3-42f1-bffa-0230e09f00e0 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:10.829733 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-9ba3b7cf-26e3-42f1-bffa-0230e09f00e0 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:10.831127 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-9ba3b7cf-26e3-42f1-bffa-0230e09f00e0 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:10.831554 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-9ba3b7cf-26e3-42f1-bffa-0230e09f00e0 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:10.912806 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-d23ddfc9-b262-4d07-9497-72938f37bec3 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246bad06441497e9fd542cc1c84da0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ab2bde6dca4830a67ca00d0223b3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:46:10.921452 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-d23ddfc9-b262-4d07-9497-72938f37bec3 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] 10.222.0.48 "GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9" status: 200 len: 1346 microversion: 2.1 time: 0.151106 Apr 08 02:46:10.922182 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 105/208] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:10 2022] GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9 => generated 1346 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:11.036828 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-9ba3b7cf-26e3-42f1-bffa-0230e09f00e0 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:46:11.044731 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-9ba3b7cf-26e3-42f1-bffa-0230e09f00e0 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20" status: 200 len: 1521 microversion: 2.1 time: 0.232214 Apr 08 02:46:11.045267 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 104/209] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:10 2022] GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20 => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:46:11.943929 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-ba9324ee-f6cb-4152-9c43-c515c0067802 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:11.944436 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-ba9324ee-f6cb-4152-9c43-c515c0067802 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] [instance: 2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:46:11.951548 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-ba9324ee-f6cb-4152-9c43-c515c0067802 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:11.951984 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-ba9324ee-f6cb-4152-9c43-c515c0067802 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:11.952736 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-ba9324ee-f6cb-4152-9c43-c515c0067802 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:11.953158 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-ba9324ee-f6cb-4152-9c43-c515c0067802 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:12.067064 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-ab5440f0-79f7-4f2c-85d6-4934c51f6155 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:12.067674 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-ab5440f0-79f7-4f2c-85d6-4934c51f6155 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 6228b11f-244d-4e25-8b1f-e19a90cc8c20] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:46:12.075321 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ab5440f0-79f7-4f2c-85d6-4934c51f6155 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:12.075763 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ab5440f0-79f7-4f2c-85d6-4934c51f6155 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:12.076543 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ab5440f0-79f7-4f2c-85d6-4934c51f6155 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:12.076973 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ab5440f0-79f7-4f2c-85d6-4934c51f6155 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:12.235198 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-ba9324ee-f6cb-4152-9c43-c515c0067802 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246bad06441497e9fd542cc1c84da0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ab2bde6dca4830a67ca00d0223b3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:46:12.243556 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-ba9324ee-f6cb-4152-9c43-c515c0067802 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] 10.222.0.48 "GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9" status: 200 len: 1346 microversion: 2.1 time: 0.308699 Apr 08 02:46:12.244091 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 106/210] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:11 2022] GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9 => generated 1346 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:12.317978 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-ab5440f0-79f7-4f2c-85d6-4934c51f6155 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:46:12.325966 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-ab5440f0-79f7-4f2c-85d6-4934c51f6155 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20" status: 200 len: 1521 microversion: 2.1 time: 0.268356 Apr 08 02:46:12.326501 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 105/211] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:12 2022] GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20 => generated 1521 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:46:13.265743 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-19e1dcd3-5af1-480d-b0b6-0f155d3e11ea tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:13.266339 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-19e1dcd3-5af1-480d-b0b6-0f155d3e11ea tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] [instance: 2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:46:13.273811 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-19e1dcd3-5af1-480d-b0b6-0f155d3e11ea tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:13.274261 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-19e1dcd3-5af1-480d-b0b6-0f155d3e11ea tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:13.275052 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-19e1dcd3-5af1-480d-b0b6-0f155d3e11ea tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:13.275488 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-19e1dcd3-5af1-480d-b0b6-0f155d3e11ea tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:13.347760 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-19e1dcd3-5af1-480d-b0b6-0f155d3e11ea tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:13.348197 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-19e1dcd3-5af1-480d-b0b6-0f155d3e11ea tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:13.348651 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.objects.instance [None req-19e1dcd3-5af1-480d-b0b6-0f155d3e11ea tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lazy-loading 'fault' on Instance uuid 2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9 {{(pid=96920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 08 02:46:13.348782 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-09014e4d-3d0f-4233-bb0c-3580f6ea6b7d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:13.349349 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-09014e4d-3d0f-4233-bb0c-3580f6ea6b7d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 6228b11f-244d-4e25-8b1f-e19a90cc8c20] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:46:13.356366 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-09014e4d-3d0f-4233-bb0c-3580f6ea6b7d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:13.356808 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-09014e4d-3d0f-4233-bb0c-3580f6ea6b7d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:13.357566 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-09014e4d-3d0f-4233-bb0c-3580f6ea6b7d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:13.357994 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-09014e4d-3d0f-4233-bb0c-3580f6ea6b7d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:13.410327 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-19e1dcd3-5af1-480d-b0b6-0f155d3e11ea tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246bad06441497e9fd542cc1c84da0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ab2bde6dca4830a67ca00d0223b3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:46:13.418780 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-19e1dcd3-5af1-480d-b0b6-0f155d3e11ea tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] 10.222.0.48 "GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9" status: 200 len: 1351 microversion: 2.1 time: 0.162128 Apr 08 02:46:13.419297 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 107/212] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:13 2022] GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9 => generated 1351 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:13.557438 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-09014e4d-3d0f-4233-bb0c-3580f6ea6b7d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:46:13.566039 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-09014e4d-3d0f-4233-bb0c-3580f6ea6b7d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20" status: 200 len: 1521 microversion: 2.1 time: 0.226912 Apr 08 02:46:13.566557 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 106/213] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:13 2022] GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20 => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:46:14.440171 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-6ee8c093-4424-42cb-a09d-2dce7e002f1d tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:14.440768 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-6ee8c093-4424-42cb-a09d-2dce7e002f1d tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] [instance: 2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:46:14.448559 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-6ee8c093-4424-42cb-a09d-2dce7e002f1d tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:14.449028 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-6ee8c093-4424-42cb-a09d-2dce7e002f1d tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:14.449766 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-6ee8c093-4424-42cb-a09d-2dce7e002f1d tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:14.450205 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-6ee8c093-4424-42cb-a09d-2dce7e002f1d tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:14.521023 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-6ee8c093-4424-42cb-a09d-2dce7e002f1d tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:14.521467 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-6ee8c093-4424-42cb-a09d-2dce7e002f1d tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:14.521908 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.objects.instance [None req-6ee8c093-4424-42cb-a09d-2dce7e002f1d tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lazy-loading 'fault' on Instance uuid 2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9 {{(pid=96920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 08 02:46:14.582628 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-6ee8c093-4424-42cb-a09d-2dce7e002f1d tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246bad06441497e9fd542cc1c84da0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ab2bde6dca4830a67ca00d0223b3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:46:14.588612 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-3a000f94-7226-410f-a774-66b886243ed6 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:14.589245 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-3a000f94-7226-410f-a774-66b886243ed6 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 6228b11f-244d-4e25-8b1f-e19a90cc8c20] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:46:14.591807 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-6ee8c093-4424-42cb-a09d-2dce7e002f1d tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] 10.222.0.48 "GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9" status: 200 len: 1351 microversion: 2.1 time: 0.160363 Apr 08 02:46:14.592331 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 108/214] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:14 2022] GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9 => generated 1351 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:14.597300 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-3a000f94-7226-410f-a774-66b886243ed6 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:14.597740 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-3a000f94-7226-410f-a774-66b886243ed6 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:14.598540 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-3a000f94-7226-410f-a774-66b886243ed6 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:14.598996 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-3a000f94-7226-410f-a774-66b886243ed6 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:14.799291 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-3a000f94-7226-410f-a774-66b886243ed6 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:46:14.808615 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-3a000f94-7226-410f-a774-66b886243ed6 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20" status: 200 len: 1521 microversion: 2.1 time: 0.230251 Apr 08 02:46:14.809133 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 107/215] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:14 2022] GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20 => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:46:15.614034 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-b8b9aa48-7780-4fe3-9951-7456c30c0e41 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:15.614633 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-b8b9aa48-7780-4fe3-9951-7456c30c0e41 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] [instance: 2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:46:15.621676 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b8b9aa48-7780-4fe3-9951-7456c30c0e41 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:15.622120 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b8b9aa48-7780-4fe3-9951-7456c30c0e41 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:15.622917 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b8b9aa48-7780-4fe3-9951-7456c30c0e41 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:15.623347 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b8b9aa48-7780-4fe3-9951-7456c30c0e41 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:15.696861 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b8b9aa48-7780-4fe3-9951-7456c30c0e41 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:15.697298 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b8b9aa48-7780-4fe3-9951-7456c30c0e41 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:15.697739 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.objects.instance [None req-b8b9aa48-7780-4fe3-9951-7456c30c0e41 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lazy-loading 'fault' on Instance uuid 2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9 {{(pid=96920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 08 02:46:15.800424 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-b8b9aa48-7780-4fe3-9951-7456c30c0e41 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246bad06441497e9fd542cc1c84da0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ab2bde6dca4830a67ca00d0223b3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:46:15.812122 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-b8b9aa48-7780-4fe3-9951-7456c30c0e41 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] 10.222.0.48 "GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9" status: 200 len: 1351 microversion: 2.1 time: 0.206825 Apr 08 02:46:15.812660 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 109/216] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:15 2022] GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9 => generated 1351 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:15.831158 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-eb23a38a-85d9-45ef-ba46-36596712ddfa tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:15.831805 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-eb23a38a-85d9-45ef-ba46-36596712ddfa tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 6228b11f-244d-4e25-8b1f-e19a90cc8c20] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:46:15.840082 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-eb23a38a-85d9-45ef-ba46-36596712ddfa tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:15.840514 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-eb23a38a-85d9-45ef-ba46-36596712ddfa tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:15.841391 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-eb23a38a-85d9-45ef-ba46-36596712ddfa tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:15.841820 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-eb23a38a-85d9-45ef-ba46-36596712ddfa tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:16.039439 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-eb23a38a-85d9-45ef-ba46-36596712ddfa tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:46:16.047493 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-eb23a38a-85d9-45ef-ba46-36596712ddfa tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20" status: 200 len: 1521 microversion: 2.1 time: 0.226243 Apr 08 02:46:16.048028 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 108/217] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:15 2022] GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20 => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:16.834748 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-47eb88ad-7c97-4d06-9c09-3e0ff1592806 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:16.835340 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-47eb88ad-7c97-4d06-9c09-3e0ff1592806 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] [instance: 2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:46:16.842468 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-47eb88ad-7c97-4d06-9c09-3e0ff1592806 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:16.842940 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-47eb88ad-7c97-4d06-9c09-3e0ff1592806 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:16.843690 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-47eb88ad-7c97-4d06-9c09-3e0ff1592806 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:16.844115 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-47eb88ad-7c97-4d06-9c09-3e0ff1592806 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:16.914239 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-47eb88ad-7c97-4d06-9c09-3e0ff1592806 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:16.914607 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-47eb88ad-7c97-4d06-9c09-3e0ff1592806 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:16.915138 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.objects.instance [None req-47eb88ad-7c97-4d06-9c09-3e0ff1592806 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lazy-loading 'fault' on Instance uuid 2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9 {{(pid=96920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 08 02:46:16.975342 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-47eb88ad-7c97-4d06-9c09-3e0ff1592806 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2246bad06441497e9fd542cc1c84da0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ab2bde6dca4830a67ca00d0223b3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:46:16.983702 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-47eb88ad-7c97-4d06-9c09-3e0ff1592806 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] 10.222.0.48 "GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9" status: 200 len: 1351 microversion: 2.1 time: 0.157855 Apr 08 02:46:16.984236 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 110/218] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:16 2022] GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9 => generated 1351 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:17.070481 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-10bda1dc-27c8-4001-9e67-fa1cd16be9d0 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:17.071114 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-10bda1dc-27c8-4001-9e67-fa1cd16be9d0 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 6228b11f-244d-4e25-8b1f-e19a90cc8c20] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:46:17.078287 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-10bda1dc-27c8-4001-9e67-fa1cd16be9d0 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:17.078770 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-10bda1dc-27c8-4001-9e67-fa1cd16be9d0 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:17.079550 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-10bda1dc-27c8-4001-9e67-fa1cd16be9d0 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:17.079988 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-10bda1dc-27c8-4001-9e67-fa1cd16be9d0 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:17.290575 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-10bda1dc-27c8-4001-9e67-fa1cd16be9d0 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:46:17.298578 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-10bda1dc-27c8-4001-9e67-fa1cd16be9d0 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20" status: 200 len: 1521 microversion: 2.1 time: 0.237147 Apr 08 02:46:17.299695 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 109/219] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:17 2022] GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20 => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:18.005863 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-e2d49ef4-3045-4400-8528-f48202866f15 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:18.006361 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-e2d49ef4-3045-4400-8528-f48202866f15 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] [instance: 2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:46:18.014050 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-e2d49ef4-3045-4400-8528-f48202866f15 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:18.014953 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-e2d49ef4-3045-4400-8528-f48202866f15 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:18.015533 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-e2d49ef4-3045-4400-8528-f48202866f15 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:18.015961 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-e2d49ef4-3045-4400-8528-f48202866f15 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:18.064565 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.wsgi [None req-e2d49ef4-3045-4400-8528-f48202866f15 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] HTTP exception thrown: Instance 2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9 could not be found. Apr 08 02:46:18.065136 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-e2d49ef4-3045-4400-8528-f48202866f15 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Returning 404 to user: Instance 2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9 could not be found. {{(pid=96920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Apr 08 02:46:18.065943 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-e2d49ef4-3045-4400-8528-f48202866f15 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] 10.222.0.48 "GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9" status: 404 len: 111 microversion: 2.1 time: 0.069384 Apr 08 02:46:18.066469 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 111/220] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:17 2022] GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 02:46:18.235090 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-4a78c007-67b3-4cab-ba4e-4ebdcd9b1a50 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:18.236558 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-4a78c007-67b3-4cab-ba4e-4ebdcd9b1a50 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] [instance: 2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:46:18.243930 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-4a78c007-67b3-4cab-ba4e-4ebdcd9b1a50 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:18.244351 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-4a78c007-67b3-4cab-ba4e-4ebdcd9b1a50 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:18.245119 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-4a78c007-67b3-4cab-ba4e-4ebdcd9b1a50 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:18.245548 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-4a78c007-67b3-4cab-ba4e-4ebdcd9b1a50 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:18.291680 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.wsgi [None req-4a78c007-67b3-4cab-ba4e-4ebdcd9b1a50 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] HTTP exception thrown: Instance 2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9 could not be found. Apr 08 02:46:18.292279 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-4a78c007-67b3-4cab-ba4e-4ebdcd9b1a50 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Returning 404 to user: Instance 2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9 could not be found. {{(pid=96919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Apr 08 02:46:18.293087 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-4a78c007-67b3-4cab-ba4e-4ebdcd9b1a50 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] 10.222.0.48 "GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.067450 Apr 08 02:46:18.293623 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 110/221] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Apr 8 02:46:18 2022] GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9/os-volume_attachments => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 02:46:18.321729 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-498e1346-e7a9-4192-92c1-80a517fa4ed3 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:18.322343 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-498e1346-e7a9-4192-92c1-80a517fa4ed3 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 6228b11f-244d-4e25-8b1f-e19a90cc8c20] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:46:18.329475 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-498e1346-e7a9-4192-92c1-80a517fa4ed3 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:18.330492 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-498e1346-e7a9-4192-92c1-80a517fa4ed3 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:18.331298 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-498e1346-e7a9-4192-92c1-80a517fa4ed3 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:18.331732 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-498e1346-e7a9-4192-92c1-80a517fa4ed3 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:18.541400 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-498e1346-e7a9-4192-92c1-80a517fa4ed3 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:46:18.550247 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-498e1346-e7a9-4192-92c1-80a517fa4ed3 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20" status: 200 len: 1521 microversion: 2.1 time: 0.238344 Apr 08 02:46:18.550853 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 112/222] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:18 2022] GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20 => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:19.572675 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-f7936d0d-d376-413a-bde5-3546a2db12af tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:19.573950 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-f7936d0d-d376-413a-bde5-3546a2db12af tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 6228b11f-244d-4e25-8b1f-e19a90cc8c20] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:46:19.583206 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-f7936d0d-d376-413a-bde5-3546a2db12af tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:19.584151 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-f7936d0d-d376-413a-bde5-3546a2db12af tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:19.585416 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-f7936d0d-d376-413a-bde5-3546a2db12af tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:19.587637 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-f7936d0d-d376-413a-bde5-3546a2db12af tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:19.877869 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-f7936d0d-d376-413a-bde5-3546a2db12af tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:46:19.886251 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-f7936d0d-d376-413a-bde5-3546a2db12af tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20" status: 200 len: 1521 microversion: 2.1 time: 0.323241 Apr 08 02:46:19.889892 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 111/223] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:19 2022] GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20 => generated 1521 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:20.736840 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-dc2c51b5-da47-4b7e-9a69-fe69011fcbc0 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:20.737343 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-dc2c51b5-da47-4b7e-9a69-fe69011fcbc0 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] [instance: 2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:46:20.744401 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-dc2c51b5-da47-4b7e-9a69-fe69011fcbc0 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:20.744833 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-dc2c51b5-da47-4b7e-9a69-fe69011fcbc0 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:20.745589 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-dc2c51b5-da47-4b7e-9a69-fe69011fcbc0 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:20.746016 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-dc2c51b5-da47-4b7e-9a69-fe69011fcbc0 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:20.799685 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.wsgi [None req-dc2c51b5-da47-4b7e-9a69-fe69011fcbc0 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] HTTP exception thrown: Instance 2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9 could not be found. Apr 08 02:46:20.800566 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-dc2c51b5-da47-4b7e-9a69-fe69011fcbc0 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Returning 404 to user: Instance 2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9 could not be found. {{(pid=96920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Apr 08 02:46:20.801533 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-dc2c51b5-da47-4b7e-9a69-fe69011fcbc0 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] 10.222.0.48 "DELETE /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9" status: 404 len: 111 microversion: 2.1 time: 0.074187 Apr 08 02:46:20.802086 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 113/224] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Apr 8 02:46:20 2022] DELETE /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 02:46:20.816536 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-cd97f877-7c06-4ec7-bbfa-3e6b7cf9bae3 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:20.817143 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-cd97f877-7c06-4ec7-bbfa-3e6b7cf9bae3 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] [instance: 2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:46:20.824703 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-cd97f877-7c06-4ec7-bbfa-3e6b7cf9bae3 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:20.825383 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-cd97f877-7c06-4ec7-bbfa-3e6b7cf9bae3 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:20.826160 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-cd97f877-7c06-4ec7-bbfa-3e6b7cf9bae3 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:20.826800 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-cd97f877-7c06-4ec7-bbfa-3e6b7cf9bae3 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:20.881222 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.wsgi [None req-cd97f877-7c06-4ec7-bbfa-3e6b7cf9bae3 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] HTTP exception thrown: Instance 2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9 could not be found. Apr 08 02:46:20.881816 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-cd97f877-7c06-4ec7-bbfa-3e6b7cf9bae3 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] Returning 404 to user: Instance 2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9 could not be found. {{(pid=96919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Apr 08 02:46:20.882689 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-cd97f877-7c06-4ec7-bbfa-3e6b7cf9bae3 tempest-DeleteServersTestJSON-1176442129 tempest-DeleteServersTestJSON-1176442129-project] 10.222.0.48 "GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9" status: 404 len: 111 microversion: 2.1 time: 0.075982 Apr 08 02:46:20.883263 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 112/225] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:20 2022] GET /compute/v2.1/servers/2a2e1e48-b2a6-43d6-8f2a-2b373a259ed9 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 02:46:20.919423 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-1fcb4cf9-9cff-42d8-bc8b-9a66a53b8621 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:20.920032 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-1fcb4cf9-9cff-42d8-bc8b-9a66a53b8621 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 6228b11f-244d-4e25-8b1f-e19a90cc8c20] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:46:20.935063 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-1fcb4cf9-9cff-42d8-bc8b-9a66a53b8621 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:20.935510 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-1fcb4cf9-9cff-42d8-bc8b-9a66a53b8621 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:20.936341 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-1fcb4cf9-9cff-42d8-bc8b-9a66a53b8621 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:20.936767 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-1fcb4cf9-9cff-42d8-bc8b-9a66a53b8621 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:21.359655 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-1fcb4cf9-9cff-42d8-bc8b-9a66a53b8621 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:46:21.368920 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-1fcb4cf9-9cff-42d8-bc8b-9a66a53b8621 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20" status: 200 len: 1521 microversion: 2.1 time: 0.469295 Apr 08 02:46:21.369468 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 114/226] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:20 2022] GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20 => generated 1521 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:22.391536 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-e636c6f6-f256-41e9-95e0-f846c809d054 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:22.393805 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-e636c6f6-f256-41e9-95e0-f846c809d054 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 6228b11f-244d-4e25-8b1f-e19a90cc8c20] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:46:22.403126 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-e636c6f6-f256-41e9-95e0-f846c809d054 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:22.403821 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-e636c6f6-f256-41e9-95e0-f846c809d054 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:22.404770 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-e636c6f6-f256-41e9-95e0-f846c809d054 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:22.405360 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-e636c6f6-f256-41e9-95e0-f846c809d054 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:22.638395 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-e636c6f6-f256-41e9-95e0-f846c809d054 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:46:22.646773 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-e636c6f6-f256-41e9-95e0-f846c809d054 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20" status: 200 len: 1521 microversion: 2.1 time: 0.264398 Apr 08 02:46:22.647542 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 113/227] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:22 2022] GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20 => generated 1521 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:23.670279 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-c7969a8e-c54c-43c3-bbf6-72490db54175 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:23.670820 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-c7969a8e-c54c-43c3-bbf6-72490db54175 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 6228b11f-244d-4e25-8b1f-e19a90cc8c20] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:46:23.678448 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c7969a8e-c54c-43c3-bbf6-72490db54175 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:23.678910 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c7969a8e-c54c-43c3-bbf6-72490db54175 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:23.681091 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c7969a8e-c54c-43c3-bbf6-72490db54175 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:23.682026 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c7969a8e-c54c-43c3-bbf6-72490db54175 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:23.996655 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-c7969a8e-c54c-43c3-bbf6-72490db54175 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:46:24.008094 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-c7969a8e-c54c-43c3-bbf6-72490db54175 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20" status: 200 len: 1521 microversion: 2.1 time: 0.346998 Apr 08 02:46:24.008640 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 115/228] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:23 2022] GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20 => generated 1521 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:25.030236 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-6c262cb9-3a4f-4d06-95ef-09d759cf753b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:25.033592 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-6c262cb9-3a4f-4d06-95ef-09d759cf753b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 6228b11f-244d-4e25-8b1f-e19a90cc8c20] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:46:25.042333 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-6c262cb9-3a4f-4d06-95ef-09d759cf753b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:25.043027 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-6c262cb9-3a4f-4d06-95ef-09d759cf753b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:25.044123 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-6c262cb9-3a4f-4d06-95ef-09d759cf753b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:25.044780 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-6c262cb9-3a4f-4d06-95ef-09d759cf753b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:25.279844 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-6c262cb9-3a4f-4d06-95ef-09d759cf753b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:46:25.305518 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-6c262cb9-3a4f-4d06-95ef-09d759cf753b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20" status: 200 len: 1521 microversion: 2.1 time: 0.284113 Apr 08 02:46:25.306085 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 114/229] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:25 2022] GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20 => generated 1521 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:26.328286 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-e896f5db-e951-4643-a73a-9b034a1d595d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:26.330146 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-e896f5db-e951-4643-a73a-9b034a1d595d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 6228b11f-244d-4e25-8b1f-e19a90cc8c20] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:46:26.337965 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-e896f5db-e951-4643-a73a-9b034a1d595d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:26.338845 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-e896f5db-e951-4643-a73a-9b034a1d595d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:26.339837 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-e896f5db-e951-4643-a73a-9b034a1d595d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:26.340473 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-e896f5db-e951-4643-a73a-9b034a1d595d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:26.612809 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-e896f5db-e951-4643-a73a-9b034a1d595d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:46:26.621461 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-e896f5db-e951-4643-a73a-9b034a1d595d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20" status: 200 len: 1521 microversion: 2.1 time: 0.302302 Apr 08 02:46:26.622324 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 116/230] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:26 2022] GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20 => generated 1521 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:27.653607 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-4c630008-606a-4a61-b31a-789a601fe4d8 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:27.655023 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-4c630008-606a-4a61-b31a-789a601fe4d8 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 6228b11f-244d-4e25-8b1f-e19a90cc8c20] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:46:27.669693 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-4c630008-606a-4a61-b31a-789a601fe4d8 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:27.670521 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-4c630008-606a-4a61-b31a-789a601fe4d8 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:27.676948 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-4c630008-606a-4a61-b31a-789a601fe4d8 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:27.677656 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-4c630008-606a-4a61-b31a-789a601fe4d8 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:27.932866 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-4c630008-606a-4a61-b31a-789a601fe4d8 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:46:27.942073 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-4c630008-606a-4a61-b31a-789a601fe4d8 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20" status: 200 len: 1521 microversion: 2.1 time: 0.306595 Apr 08 02:46:27.942914 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 115/231] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:27 2022] GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20 => generated 1521 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:28.964441 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-a1747cba-3cac-48f3-bb4d-b0e529e3ff57 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:28.964969 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-a1747cba-3cac-48f3-bb4d-b0e529e3ff57 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 6228b11f-244d-4e25-8b1f-e19a90cc8c20] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:46:28.973672 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-a1747cba-3cac-48f3-bb4d-b0e529e3ff57 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:28.974112 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-a1747cba-3cac-48f3-bb4d-b0e529e3ff57 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:28.974924 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-a1747cba-3cac-48f3-bb4d-b0e529e3ff57 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:28.975355 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-a1747cba-3cac-48f3-bb4d-b0e529e3ff57 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:29.253997 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-a1747cba-3cac-48f3-bb4d-b0e529e3ff57 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:46:29.268498 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-a1747cba-3cac-48f3-bb4d-b0e529e3ff57 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20" status: 200 len: 1521 microversion: 2.1 time: 0.313138 Apr 08 02:46:29.269273 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 117/232] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:28 2022] GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20 => generated 1521 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:29.326186 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-04cbbee4-0839-4e5d-bb45-ab5ec192d43c tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Action: 'create', calling method: .version_select at 0x7f7d4e31fca0>, body: {"keypair": {"name": "tempest-keypair-218229824"}} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:46:29.358415 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.quota [None req-04cbbee4-0839-4e5d-bb45-ab5ec192d43c tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Getting quotas for project d7c31bb4f3ce486591bc142b1da7553e. Resources: {'key_pairs'} {{(pid=96919) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:46:29.363771 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.quota [None req-04cbbee4-0839-4e5d-bb45-ab5ec192d43c tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Getting quotas for user e2a88a8d7c9e4d0a88308c0e894570be and project d7c31bb4f3ce486591bc142b1da7553e. Resources: {'key_pairs'} {{(pid=96919) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:46:29.551734 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.quota [None req-04cbbee4-0839-4e5d-bb45-ab5ec192d43c tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Getting quotas for project d7c31bb4f3ce486591bc142b1da7553e. Resources: {'key_pairs'} {{(pid=96919) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:46:29.558785 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.quota [None req-04cbbee4-0839-4e5d-bb45-ab5ec192d43c tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Getting quotas for user e2a88a8d7c9e4d0a88308c0e894570be and project d7c31bb4f3ce486591bc142b1da7553e. Resources: {'key_pairs'} {{(pid=96919) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:46:29.570335 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-04cbbee4-0839-4e5d-bb45-ab5ec192d43c tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.430218 Apr 08 02:46:29.570978 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 116/233] 10.222.0.48 () {60 vars in 1157 bytes} [Fri Apr 8 02:46:29 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:30.292123 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-95a1a99a-9eea-4975-8469-99d259bd05ec tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:30.292726 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-95a1a99a-9eea-4975-8469-99d259bd05ec tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 6228b11f-244d-4e25-8b1f-e19a90cc8c20] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:46:30.300466 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-95a1a99a-9eea-4975-8469-99d259bd05ec tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:30.300918 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-95a1a99a-9eea-4975-8469-99d259bd05ec tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:30.301705 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-95a1a99a-9eea-4975-8469-99d259bd05ec tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:30.302132 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-95a1a99a-9eea-4975-8469-99d259bd05ec tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:30.520871 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-95a1a99a-9eea-4975-8469-99d259bd05ec tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:46:30.528858 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-95a1a99a-9eea-4975-8469-99d259bd05ec tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20" status: 200 len: 1521 microversion: 2.1 time: 0.247503 Apr 08 02:46:30.529396 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 118/234] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:30 2022] GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20 => generated 1521 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:31.380295 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-c37c00c6-820e-4056-b277-5cab6391ddc4 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1153609242", "imageRef": "7f8ca061-f382-4052-8d05-69f37e107684", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5dea2017-1900-4ff0-b5ef-6938292bd5df"}], "security_groups": [{"name": "tempest-securitygroup--299814529"}], "key_name": "tempest-keypair-218229824", "user_data": "}} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:46:31.533866 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.network.neutron [None req-c37c00c6-820e-4056-b277-5cab6391ddc4 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] validate_networks() for [('5dea2017-1900-4ff0-b5ef-6938292bd5df', None, None, None)] {{(pid=96919) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} Apr 08 02:46:31.551732 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-cf8cc7bd-b5f9-49c0-b8ba-63348a7a888e tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:31.552464 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-cf8cc7bd-b5f9-49c0-b8ba-63348a7a888e tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 6228b11f-244d-4e25-8b1f-e19a90cc8c20] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:46:31.560553 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-cf8cc7bd-b5f9-49c0-b8ba-63348a7a888e tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:31.561098 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-cf8cc7bd-b5f9-49c0-b8ba-63348a7a888e tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:31.561971 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-cf8cc7bd-b5f9-49c0-b8ba-63348a7a888e tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:31.562499 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-cf8cc7bd-b5f9-49c0-b8ba-63348a7a888e tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:31.879594 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-cf8cc7bd-b5f9-49c0-b8ba-63348a7a888e tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:46:31.888955 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-cf8cc7bd-b5f9-49c0-b8ba-63348a7a888e tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20" status: 200 len: 1521 microversion: 2.1 time: 0.346646 Apr 08 02:46:31.889505 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 119/235] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:31 2022] GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20 => generated 1521 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:46:32.188982 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.virt.hardware [None req-c37c00c6-820e-4056-b277-5cab6391ddc4 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Flavor limits 0:0:0 {{(pid=96919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} Apr 08 02:46:32.189441 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.virt.hardware [None req-c37c00c6-820e-4056-b277-5cab6391ddc4 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Image limits 0:0:0 {{(pid=96919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} Apr 08 02:46:32.189912 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.virt.hardware [None req-c37c00c6-820e-4056-b277-5cab6391ddc4 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Flavor pref 0:0:0 {{(pid=96919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} Apr 08 02:46:32.190355 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.virt.hardware [None req-c37c00c6-820e-4056-b277-5cab6391ddc4 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Image pref 0:0:0 {{(pid=96919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} Apr 08 02:46:32.190824 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.virt.hardware [None req-c37c00c6-820e-4056-b277-5cab6391ddc4 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=96919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} Apr 08 02:46:32.199113 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-c37c00c6-820e-4056-b277-5cab6391ddc4 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:32.199562 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-c37c00c6-820e-4056-b277-5cab6391ddc4 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:32.200364 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-c37c00c6-820e-4056-b277-5cab6391ddc4 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:32.200793 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-c37c00c6-820e-4056-b277-5cab6391ddc4 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:32.218781 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.quota [None req-c37c00c6-820e-4056-b277-5cab6391ddc4 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Getting quotas for project d7c31bb4f3ce486591bc142b1da7553e. Resources: {'instances', 'cores', 'ram'} {{(pid=96919) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:46:32.223880 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.quota [None req-c37c00c6-820e-4056-b277-5cab6391ddc4 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Getting quotas for user e2a88a8d7c9e4d0a88308c0e894570be and project d7c31bb4f3ce486591bc142b1da7553e. Resources: {'instances', 'cores', 'ram'} {{(pid=96919) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:46:32.237636 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-c37c00c6-820e-4056-b277-5cab6391ddc4 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Going to run 1 instances... {{(pid=96919) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} Apr 08 02:46:32.240008 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-c37c00c6-820e-4056-b277-5cab6391ddc4 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 19ff8616-8e62-40fe-87e7-f976433b9288] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7f8ca061-f382-4052-8d05-69f37e107684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=96919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} Apr 08 02:46:32.286761 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-c37c00c6-820e-4056-b277-5cab6391ddc4 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.917467 Apr 08 02:46:32.292553 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 117/236] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Apr 8 02:46:31 2022] POST /compute/v2.1/servers => generated 401 bytes in 924 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 08 02:46:32.305382 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-d5e130c9-299d-4d18-8657-ea8f86e49493 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:32.305991 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-d5e130c9-299d-4d18-8657-ea8f86e49493 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 19ff8616-8e62-40fe-87e7-f976433b9288] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:46:32.394820 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-d5e130c9-299d-4d18-8657-ea8f86e49493 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a88a8d7c9e4d0a88308c0e894570be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c31bb4f3ce486591bc142b1da7553e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:46:32.404439 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-d5e130c9-299d-4d18-8657-ea8f86e49493 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288" status: 200 len: 1237 microversion: 2.1 time: 0.110640 Apr 08 02:46:32.404989 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 120/237] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:32 2022] GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288 => generated 1237 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:32.912915 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-4cac8b1a-63ae-4fd4-82ff-f0fb52a3df0c tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:32.913629 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-4cac8b1a-63ae-4fd4-82ff-f0fb52a3df0c tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 6228b11f-244d-4e25-8b1f-e19a90cc8c20] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:46:32.920922 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-4cac8b1a-63ae-4fd4-82ff-f0fb52a3df0c tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:32.921364 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-4cac8b1a-63ae-4fd4-82ff-f0fb52a3df0c tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:32.922175 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-4cac8b1a-63ae-4fd4-82ff-f0fb52a3df0c tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:32.922555 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-4cac8b1a-63ae-4fd4-82ff-f0fb52a3df0c tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:33.162586 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-4cac8b1a-63ae-4fd4-82ff-f0fb52a3df0c tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:46:33.172027 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-4cac8b1a-63ae-4fd4-82ff-f0fb52a3df0c tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20" status: 200 len: 1521 microversion: 2.1 time: 0.268854 Apr 08 02:46:33.172643 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 118/238] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:32 2022] GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20 => generated 1521 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:33.428388 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-2270cfd9-2ba4-4be3-8df7-7d510ddda9cc tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:33.429089 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-2270cfd9-2ba4-4be3-8df7-7d510ddda9cc tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 19ff8616-8e62-40fe-87e7-f976433b9288] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:46:33.436653 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-2270cfd9-2ba4-4be3-8df7-7d510ddda9cc tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:33.437367 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-2270cfd9-2ba4-4be3-8df7-7d510ddda9cc tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:33.438378 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-2270cfd9-2ba4-4be3-8df7-7d510ddda9cc tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:33.439555 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-2270cfd9-2ba4-4be3-8df7-7d510ddda9cc tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:33.564005 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-2270cfd9-2ba4-4be3-8df7-7d510ddda9cc tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a88a8d7c9e4d0a88308c0e894570be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c31bb4f3ce486591bc142b1da7553e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:46:33.572416 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-2270cfd9-2ba4-4be3-8df7-7d510ddda9cc tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288" status: 200 len: 1289 microversion: 2.1 time: 0.154371 Apr 08 02:46:33.573316 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 121/239] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:33 2022] GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288 => generated 1289 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:34.199180 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-8a8141d5-e592-43c4-91fc-309a4fbbfbd1 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:34.200368 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-8a8141d5-e592-43c4-91fc-309a4fbbfbd1 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 6228b11f-244d-4e25-8b1f-e19a90cc8c20] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:46:34.210913 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-8a8141d5-e592-43c4-91fc-309a4fbbfbd1 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:34.211680 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-8a8141d5-e592-43c4-91fc-309a4fbbfbd1 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:34.212609 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-8a8141d5-e592-43c4-91fc-309a4fbbfbd1 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:34.213187 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-8a8141d5-e592-43c4-91fc-309a4fbbfbd1 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:34.517017 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-8a8141d5-e592-43c4-91fc-309a4fbbfbd1 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:46:34.531523 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-8a8141d5-e592-43c4-91fc-309a4fbbfbd1 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20" status: 200 len: 1521 microversion: 2.1 time: 0.338705 Apr 08 02:46:34.532619 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 119/240] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:34 2022] GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20 => generated 1521 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:34.597584 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-c725d281-9ace-477e-bdf0-ef673e0a5cf7 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:34.598897 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-c725d281-9ace-477e-bdf0-ef673e0a5cf7 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 19ff8616-8e62-40fe-87e7-f976433b9288] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:46:34.608230 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c725d281-9ace-477e-bdf0-ef673e0a5cf7 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:34.608921 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c725d281-9ace-477e-bdf0-ef673e0a5cf7 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:34.609857 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c725d281-9ace-477e-bdf0-ef673e0a5cf7 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:34.610487 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c725d281-9ace-477e-bdf0-ef673e0a5cf7 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:34.772684 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-c725d281-9ace-477e-bdf0-ef673e0a5cf7 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a88a8d7c9e4d0a88308c0e894570be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c31bb4f3ce486591bc142b1da7553e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:46:34.781344 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-c725d281-9ace-477e-bdf0-ef673e0a5cf7 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288" status: 200 len: 1295 microversion: 2.1 time: 0.195754 Apr 08 02:46:34.781883 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 122/241] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:34 2022] GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288 => generated 1295 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:35.576123 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-ddb4bcca-e12e-4ce0-9ad0-7622a4ef5d6b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:35.577174 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-ddb4bcca-e12e-4ce0-9ad0-7622a4ef5d6b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 6228b11f-244d-4e25-8b1f-e19a90cc8c20] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:46:35.588574 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ddb4bcca-e12e-4ce0-9ad0-7622a4ef5d6b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:35.589706 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ddb4bcca-e12e-4ce0-9ad0-7622a4ef5d6b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:35.590740 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ddb4bcca-e12e-4ce0-9ad0-7622a4ef5d6b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:35.591365 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ddb4bcca-e12e-4ce0-9ad0-7622a4ef5d6b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:35.807578 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-b74f39b5-b8b0-42b2-9ca3-48881c65afb9 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:35.810062 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-b74f39b5-b8b0-42b2-9ca3-48881c65afb9 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 19ff8616-8e62-40fe-87e7-f976433b9288] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:46:35.818654 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b74f39b5-b8b0-42b2-9ca3-48881c65afb9 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:35.819454 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b74f39b5-b8b0-42b2-9ca3-48881c65afb9 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:35.820430 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b74f39b5-b8b0-42b2-9ca3-48881c65afb9 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:35.821035 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b74f39b5-b8b0-42b2-9ca3-48881c65afb9 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:35.858414 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-ddb4bcca-e12e-4ce0-9ad0-7622a4ef5d6b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:46:35.873087 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-ddb4bcca-e12e-4ce0-9ad0-7622a4ef5d6b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20" status: 200 len: 1521 microversion: 2.1 time: 0.327890 Apr 08 02:46:35.874223 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 120/242] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:35 2022] GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20 => generated 1521 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:36.099642 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-b74f39b5-b8b0-42b2-9ca3-48881c65afb9 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a88a8d7c9e4d0a88308c0e894570be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c31bb4f3ce486591bc142b1da7553e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:46:36.113923 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-b74f39b5-b8b0-42b2-9ca3-48881c65afb9 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288" status: 200 len: 1362 microversion: 2.1 time: 0.319114 Apr 08 02:46:36.127881 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 123/243] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:35 2022] GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288 => generated 1362 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:46:36.408453 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [req-e699d7dd-477e-44d8-9d6c-739a96145750 req-9b219ad6-85b5-4667-81a2-ea0cdefc31c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19ff8616-8e62-40fe-87e7-f976433b9288", "tag": "13eae4a8-fba8-4afe-8767-4b3ffface99b"}]} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:46:36.414828 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:46:36.414828 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: warnings.warn(msg) Apr 08 02:46:36.425687 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-e699d7dd-477e-44d8-9d6c-739a96145750 req-9b219ad6-85b5-4667-81a2-ea0cdefc31c3 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:36.426130 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-e699d7dd-477e-44d8-9d6c-739a96145750 req-9b219ad6-85b5-4667-81a2-ea0cdefc31c3 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:36.444432 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.compute.server_external_events [req-e699d7dd-477e-44d8-9d6c-739a96145750 req-9b219ad6-85b5-4667-81a2-ea0cdefc31c3 service nova] Creating event network-changed:13eae4a8-fba8-4afe-8767-4b3ffface99b for instance 19ff8616-8e62-40fe-87e7-f976433b9288 on hv-cinder-83705 Apr 08 02:46:36.449371 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [req-e699d7dd-477e-44d8-9d6c-739a96145750 req-9b219ad6-85b5-4667-81a2-ea0cdefc31c3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050847 Apr 08 02:46:36.449956 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 121/244] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:46:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:46:36.896999 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-b1ea5449-0643-4c63-96a4-7bde101dd928 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:36.897591 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-b1ea5449-0643-4c63-96a4-7bde101dd928 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 6228b11f-244d-4e25-8b1f-e19a90cc8c20] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:46:36.904791 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b1ea5449-0643-4c63-96a4-7bde101dd928 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:36.905227 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b1ea5449-0643-4c63-96a4-7bde101dd928 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:36.905972 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b1ea5449-0643-4c63-96a4-7bde101dd928 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:36.906397 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b1ea5449-0643-4c63-96a4-7bde101dd928 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:37.113271 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-b1ea5449-0643-4c63-96a4-7bde101dd928 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:46:37.121439 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-b1ea5449-0643-4c63-96a4-7bde101dd928 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20" status: 200 len: 1521 microversion: 2.1 time: 0.233433 Apr 08 02:46:37.121971 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 124/245] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:36 2022] GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20 => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:37.142632 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-7386301c-72d9-4655-8c7b-2830c8955dc9 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:37.143878 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-7386301c-72d9-4655-8c7b-2830c8955dc9 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 19ff8616-8e62-40fe-87e7-f976433b9288] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:46:37.151676 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-7386301c-72d9-4655-8c7b-2830c8955dc9 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:37.152101 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-7386301c-72d9-4655-8c7b-2830c8955dc9 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:37.152903 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-7386301c-72d9-4655-8c7b-2830c8955dc9 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:37.153335 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-7386301c-72d9-4655-8c7b-2830c8955dc9 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:37.356415 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-7386301c-72d9-4655-8c7b-2830c8955dc9 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a88a8d7c9e4d0a88308c0e894570be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c31bb4f3ce486591bc142b1da7553e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:46:37.365396 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-7386301c-72d9-4655-8c7b-2830c8955dc9 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288" status: 200 len: 1362 microversion: 2.1 time: 0.233601 Apr 08 02:46:37.369496 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 122/246] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:37 2022] GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288 => generated 1362 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:38.147242 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-11330353-eddd-4444-98b5-d1b4d99bd79b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:38.147852 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-11330353-eddd-4444-98b5-d1b4d99bd79b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 6228b11f-244d-4e25-8b1f-e19a90cc8c20] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:46:38.155597 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-11330353-eddd-4444-98b5-d1b4d99bd79b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:38.156048 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-11330353-eddd-4444-98b5-d1b4d99bd79b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:38.156826 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-11330353-eddd-4444-98b5-d1b4d99bd79b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:38.158472 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-11330353-eddd-4444-98b5-d1b4d99bd79b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:38.364514 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-11330353-eddd-4444-98b5-d1b4d99bd79b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:46:38.372393 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-11330353-eddd-4444-98b5-d1b4d99bd79b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20" status: 200 len: 1521 microversion: 2.1 time: 0.235087 Apr 08 02:46:38.372915 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 125/247] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:38 2022] GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20 => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:38.387261 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-c336e651-5296-4373-a728-6f099b01b1ce tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:38.387869 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-c336e651-5296-4373-a728-6f099b01b1ce tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 19ff8616-8e62-40fe-87e7-f976433b9288] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:46:38.396062 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-c336e651-5296-4373-a728-6f099b01b1ce tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:38.396507 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-c336e651-5296-4373-a728-6f099b01b1ce tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:38.397275 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-c336e651-5296-4373-a728-6f099b01b1ce tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:38.397706 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-c336e651-5296-4373-a728-6f099b01b1ce tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:38.616707 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-c336e651-5296-4373-a728-6f099b01b1ce tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a88a8d7c9e4d0a88308c0e894570be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c31bb4f3ce486591bc142b1da7553e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:46:38.624580 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-c336e651-5296-4373-a728-6f099b01b1ce tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288" status: 200 len: 1362 microversion: 2.1 time: 0.246382 Apr 08 02:46:38.625106 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 123/248] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:38 2022] GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288 => generated 1362 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:39.395310 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-4c5cf952-5a52-46a1-bb45-4c5ca9550449 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:39.395905 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-4c5cf952-5a52-46a1-bb45-4c5ca9550449 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 6228b11f-244d-4e25-8b1f-e19a90cc8c20] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:46:39.403101 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-4c5cf952-5a52-46a1-bb45-4c5ca9550449 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:39.403547 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-4c5cf952-5a52-46a1-bb45-4c5ca9550449 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:39.404301 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-4c5cf952-5a52-46a1-bb45-4c5ca9550449 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:39.406737 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-4c5cf952-5a52-46a1-bb45-4c5ca9550449 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:39.646693 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-de8fdb27-a610-448f-be54-53d48c844656 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:39.647295 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-de8fdb27-a610-448f-be54-53d48c844656 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 19ff8616-8e62-40fe-87e7-f976433b9288] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:46:39.653049 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-4c5cf952-5a52-46a1-bb45-4c5ca9550449 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:46:39.654410 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-de8fdb27-a610-448f-be54-53d48c844656 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:39.654879 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-de8fdb27-a610-448f-be54-53d48c844656 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:39.655649 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-de8fdb27-a610-448f-be54-53d48c844656 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:39.656076 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-de8fdb27-a610-448f-be54-53d48c844656 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:39.661561 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-4c5cf952-5a52-46a1-bb45-4c5ca9550449 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20" status: 200 len: 1521 microversion: 2.1 time: 0.276248 Apr 08 02:46:39.662093 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 126/249] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:39 2022] GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20 => generated 1521 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:39.853598 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-de8fdb27-a610-448f-be54-53d48c844656 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a88a8d7c9e4d0a88308c0e894570be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c31bb4f3ce486591bc142b1da7553e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:46:39.862018 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-de8fdb27-a610-448f-be54-53d48c844656 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288" status: 200 len: 1362 microversion: 2.1 time: 0.224632 Apr 08 02:46:39.862556 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 124/250] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:39 2022] GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288 => generated 1362 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:46:40.683702 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-91ce47de-e8a4-40ad-913b-d702d58ae80b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:40.684306 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-91ce47de-e8a4-40ad-913b-d702d58ae80b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 6228b11f-244d-4e25-8b1f-e19a90cc8c20] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:46:40.691611 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-91ce47de-e8a4-40ad-913b-d702d58ae80b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:40.692052 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-91ce47de-e8a4-40ad-913b-d702d58ae80b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:40.692818 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-91ce47de-e8a4-40ad-913b-d702d58ae80b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:40.693244 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-91ce47de-e8a4-40ad-913b-d702d58ae80b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:40.885733 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-f102a820-4e51-465a-8fbd-d3bb86412e0f tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:40.886433 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-f102a820-4e51-465a-8fbd-d3bb86412e0f tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 19ff8616-8e62-40fe-87e7-f976433b9288] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:46:40.894880 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-f102a820-4e51-465a-8fbd-d3bb86412e0f tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:40.895577 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-f102a820-4e51-465a-8fbd-d3bb86412e0f tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:40.896189 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-91ce47de-e8a4-40ad-913b-d702d58ae80b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:46:40.896544 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-f102a820-4e51-465a-8fbd-d3bb86412e0f tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:40.897070 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-f102a820-4e51-465a-8fbd-d3bb86412e0f tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:40.905175 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-91ce47de-e8a4-40ad-913b-d702d58ae80b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20" status: 200 len: 1521 microversion: 2.1 time: 0.230834 Apr 08 02:46:40.905715 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 127/251] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:40 2022] GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20 => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:41.112735 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-f102a820-4e51-465a-8fbd-d3bb86412e0f tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a88a8d7c9e4d0a88308c0e894570be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c31bb4f3ce486591bc142b1da7553e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:46:41.121728 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-f102a820-4e51-465a-8fbd-d3bb86412e0f tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288" status: 200 len: 1362 microversion: 2.1 time: 0.246692 Apr 08 02:46:41.124739 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 125/252] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:40 2022] GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288 => generated 1362 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:41.928066 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-b6dea812-dd21-4935-ba10-fed142560780 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:41.928653 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-b6dea812-dd21-4935-ba10-fed142560780 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 6228b11f-244d-4e25-8b1f-e19a90cc8c20] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:46:41.936266 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b6dea812-dd21-4935-ba10-fed142560780 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:41.936706 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b6dea812-dd21-4935-ba10-fed142560780 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:41.937474 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b6dea812-dd21-4935-ba10-fed142560780 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:41.937899 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b6dea812-dd21-4935-ba10-fed142560780 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:42.145330 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-b6dea812-dd21-4935-ba10-fed142560780 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:46:42.147820 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-95ef6821-f3b1-4815-9750-9ded92504a55 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:42.148441 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-95ef6821-f3b1-4815-9750-9ded92504a55 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 19ff8616-8e62-40fe-87e7-f976433b9288] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:46:42.153846 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-b6dea812-dd21-4935-ba10-fed142560780 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20" status: 200 len: 1521 microversion: 2.1 time: 0.235302 Apr 08 02:46:42.154470 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 128/253] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:41 2022] GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20 => generated 1521 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:42.155478 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-95ef6821-f3b1-4815-9750-9ded92504a55 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:42.156001 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-95ef6821-f3b1-4815-9750-9ded92504a55 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:42.156936 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-95ef6821-f3b1-4815-9750-9ded92504a55 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:42.158006 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-95ef6821-f3b1-4815-9750-9ded92504a55 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:42.393734 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-95ef6821-f3b1-4815-9750-9ded92504a55 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a88a8d7c9e4d0a88308c0e894570be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c31bb4f3ce486591bc142b1da7553e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:46:42.402335 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-95ef6821-f3b1-4815-9750-9ded92504a55 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288" status: 200 len: 1362 microversion: 2.1 time: 0.264697 Apr 08 02:46:42.403246 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 126/254] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:42 2022] GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288 => generated 1362 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:46:43.182991 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-4249f6de-b19b-4849-b717-46b175cece5a tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:43.183593 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-4249f6de-b19b-4849-b717-46b175cece5a tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 6228b11f-244d-4e25-8b1f-e19a90cc8c20] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:46:43.192101 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-4249f6de-b19b-4849-b717-46b175cece5a tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:43.192546 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-4249f6de-b19b-4849-b717-46b175cece5a tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:43.193312 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-4249f6de-b19b-4849-b717-46b175cece5a tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:43.193733 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-4249f6de-b19b-4849-b717-46b175cece5a tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:43.413722 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-4249f6de-b19b-4849-b717-46b175cece5a tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:46:43.427959 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-fdaa3d72-182e-4b06-8068-da74d8fbe9fd tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:43.428849 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-fdaa3d72-182e-4b06-8068-da74d8fbe9fd tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 19ff8616-8e62-40fe-87e7-f976433b9288] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:46:43.428925 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-4249f6de-b19b-4849-b717-46b175cece5a tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20" status: 200 len: 1521 microversion: 2.1 time: 0.260230 Apr 08 02:46:43.429449 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 129/255] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:43 2022] GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20 => generated 1521 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:43.437368 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-fdaa3d72-182e-4b06-8068-da74d8fbe9fd tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:43.437802 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-fdaa3d72-182e-4b06-8068-da74d8fbe9fd tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:43.439131 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-fdaa3d72-182e-4b06-8068-da74d8fbe9fd tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:43.439809 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-fdaa3d72-182e-4b06-8068-da74d8fbe9fd tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:43.638365 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-fdaa3d72-182e-4b06-8068-da74d8fbe9fd tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a88a8d7c9e4d0a88308c0e894570be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c31bb4f3ce486591bc142b1da7553e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:46:43.646794 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-fdaa3d72-182e-4b06-8068-da74d8fbe9fd tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288" status: 200 len: 1362 microversion: 2.1 time: 0.229709 Apr 08 02:46:43.647334 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 127/256] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:43 2022] GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288 => generated 1362 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:46:44.452126 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-f3190410-c23a-4cd8-bb0e-1de6da8a745f tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:44.452720 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-f3190410-c23a-4cd8-bb0e-1de6da8a745f tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 6228b11f-244d-4e25-8b1f-e19a90cc8c20] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:46:44.459946 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-f3190410-c23a-4cd8-bb0e-1de6da8a745f tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:44.460386 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-f3190410-c23a-4cd8-bb0e-1de6da8a745f tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:44.461142 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-f3190410-c23a-4cd8-bb0e-1de6da8a745f tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:44.461566 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-f3190410-c23a-4cd8-bb0e-1de6da8a745f tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:44.661481 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-f3190410-c23a-4cd8-bb0e-1de6da8a745f tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:46:44.667534 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-6d5613fc-98f4-4106-b756-b593db136b55 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:44.668129 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-6d5613fc-98f4-4106-b756-b593db136b55 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 19ff8616-8e62-40fe-87e7-f976433b9288] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:46:44.669516 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-f3190410-c23a-4cd8-bb0e-1de6da8a745f tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20" status: 200 len: 1521 microversion: 2.1 time: 0.226353 Apr 08 02:46:44.670040 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 130/257] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:44 2022] GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20 => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:44.675722 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-6d5613fc-98f4-4106-b756-b593db136b55 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:44.676161 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-6d5613fc-98f4-4106-b756-b593db136b55 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:44.676930 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-6d5613fc-98f4-4106-b756-b593db136b55 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:44.677355 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-6d5613fc-98f4-4106-b756-b593db136b55 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:44.875364 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-6d5613fc-98f4-4106-b756-b593db136b55 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a88a8d7c9e4d0a88308c0e894570be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c31bb4f3ce486591bc142b1da7553e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:46:44.883863 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-6d5613fc-98f4-4106-b756-b593db136b55 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288" status: 200 len: 1362 microversion: 2.1 time: 0.225211 Apr 08 02:46:44.884390 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 128/258] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:44 2022] GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288 => generated 1362 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:46:45.691949 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-2639df50-b69c-48da-b5e8-5cd1144b2401 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:45.692629 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-2639df50-b69c-48da-b5e8-5cd1144b2401 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 6228b11f-244d-4e25-8b1f-e19a90cc8c20] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:46:45.699712 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-2639df50-b69c-48da-b5e8-5cd1144b2401 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:45.700154 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-2639df50-b69c-48da-b5e8-5cd1144b2401 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:45.700911 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-2639df50-b69c-48da-b5e8-5cd1144b2401 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:45.701339 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-2639df50-b69c-48da-b5e8-5cd1144b2401 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:45.905083 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-82b62a61-06e2-423b-8b1d-0d898180cfa7 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:45.905689 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-82b62a61-06e2-423b-8b1d-0d898180cfa7 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 19ff8616-8e62-40fe-87e7-f976433b9288] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:46:45.909994 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-2639df50-b69c-48da-b5e8-5cd1144b2401 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:46:45.913843 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-82b62a61-06e2-423b-8b1d-0d898180cfa7 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:45.914488 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-82b62a61-06e2-423b-8b1d-0d898180cfa7 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:45.915279 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-82b62a61-06e2-423b-8b1d-0d898180cfa7 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:45.915702 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-82b62a61-06e2-423b-8b1d-0d898180cfa7 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:45.918322 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-2639df50-b69c-48da-b5e8-5cd1144b2401 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20" status: 200 len: 1521 microversion: 2.1 time: 0.235507 Apr 08 02:46:45.927937 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 131/259] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:45 2022] GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20 => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:46.123436 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-82b62a61-06e2-423b-8b1d-0d898180cfa7 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a88a8d7c9e4d0a88308c0e894570be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c31bb4f3ce486591bc142b1da7553e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:46:46.131432 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-82b62a61-06e2-423b-8b1d-0d898180cfa7 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288" status: 200 len: 1362 microversion: 2.1 time: 0.235227 Apr 08 02:46:46.131962 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 129/260] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:45 2022] GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288 => generated 1362 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:46.940497 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-ea68b1aa-7bbc-410c-a9a6-cdc6a9060e6e tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:46.941099 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-ea68b1aa-7bbc-410c-a9a6-cdc6a9060e6e tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 6228b11f-244d-4e25-8b1f-e19a90cc8c20] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:46:46.948437 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-ea68b1aa-7bbc-410c-a9a6-cdc6a9060e6e tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:46.948882 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-ea68b1aa-7bbc-410c-a9a6-cdc6a9060e6e tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:46.949646 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-ea68b1aa-7bbc-410c-a9a6-cdc6a9060e6e tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:46.950076 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-ea68b1aa-7bbc-410c-a9a6-cdc6a9060e6e tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:47.153420 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-8d8a6e54-cd81-4aac-b60a-dffd7ee1aca1 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:47.154029 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-8d8a6e54-cd81-4aac-b60a-dffd7ee1aca1 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 19ff8616-8e62-40fe-87e7-f976433b9288] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:46:47.157453 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-ea68b1aa-7bbc-410c-a9a6-cdc6a9060e6e tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:46:47.162351 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-8d8a6e54-cd81-4aac-b60a-dffd7ee1aca1 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:47.162838 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-8d8a6e54-cd81-4aac-b60a-dffd7ee1aca1 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:47.163618 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-8d8a6e54-cd81-4aac-b60a-dffd7ee1aca1 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:47.164048 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-8d8a6e54-cd81-4aac-b60a-dffd7ee1aca1 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:47.165291 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-ea68b1aa-7bbc-410c-a9a6-cdc6a9060e6e tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20" status: 200 len: 1521 microversion: 2.1 time: 0.234825 Apr 08 02:46:47.165820 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 132/261] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:46 2022] GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20 => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:47.364843 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-8d8a6e54-cd81-4aac-b60a-dffd7ee1aca1 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a88a8d7c9e4d0a88308c0e894570be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c31bb4f3ce486591bc142b1da7553e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:46:47.372767 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-8d8a6e54-cd81-4aac-b60a-dffd7ee1aca1 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288" status: 200 len: 1362 microversion: 2.1 time: 0.228170 Apr 08 02:46:47.373292 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 130/262] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:47 2022] GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288 => generated 1362 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:46:48.189440 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-3d37e001-4723-455e-8a04-a519173c19e6 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:48.190057 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-3d37e001-4723-455e-8a04-a519173c19e6 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 6228b11f-244d-4e25-8b1f-e19a90cc8c20] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:46:48.197440 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-3d37e001-4723-455e-8a04-a519173c19e6 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:48.197881 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-3d37e001-4723-455e-8a04-a519173c19e6 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:48.198647 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-3d37e001-4723-455e-8a04-a519173c19e6 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:48.199100 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-3d37e001-4723-455e-8a04-a519173c19e6 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:48.393175 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-3d37e001-4723-455e-8a04-a519173c19e6 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:46:48.395336 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-faae08e1-838c-4402-8278-bf514415c2ff tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:48.395938 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-faae08e1-838c-4402-8278-bf514415c2ff tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 19ff8616-8e62-40fe-87e7-f976433b9288] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:46:48.401400 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-3d37e001-4723-455e-8a04-a519173c19e6 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20" status: 200 len: 1521 microversion: 2.1 time: 0.222016 Apr 08 02:46:48.401930 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 133/263] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:48 2022] GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20 => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:48.402955 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-faae08e1-838c-4402-8278-bf514415c2ff tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:48.403396 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-faae08e1-838c-4402-8278-bf514415c2ff tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:48.404157 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-faae08e1-838c-4402-8278-bf514415c2ff tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:48.404582 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-faae08e1-838c-4402-8278-bf514415c2ff tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:48.608029 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-faae08e1-838c-4402-8278-bf514415c2ff tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a88a8d7c9e4d0a88308c0e894570be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c31bb4f3ce486591bc142b1da7553e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:46:48.616488 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-faae08e1-838c-4402-8278-bf514415c2ff tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288" status: 200 len: 1362 microversion: 2.1 time: 0.231030 Apr 08 02:46:48.617026 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 131/264] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:48 2022] GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288 => generated 1362 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:46:49.424272 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-49eeac05-2790-426b-92b9-65ab2cecdac0 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:49.424825 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-49eeac05-2790-426b-92b9-65ab2cecdac0 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 6228b11f-244d-4e25-8b1f-e19a90cc8c20] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:46:49.431991 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-49eeac05-2790-426b-92b9-65ab2cecdac0 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:49.432431 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-49eeac05-2790-426b-92b9-65ab2cecdac0 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:49.433189 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-49eeac05-2790-426b-92b9-65ab2cecdac0 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:49.433618 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-49eeac05-2790-426b-92b9-65ab2cecdac0 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:49.631553 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-49eeac05-2790-426b-92b9-65ab2cecdac0 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:46:49.638953 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-2519328f-a1ab-4cbf-851b-420beb29dd03 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:49.639552 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-49eeac05-2790-426b-92b9-65ab2cecdac0 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20" status: 200 len: 1521 microversion: 2.1 time: 0.224241 Apr 08 02:46:49.639654 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-2519328f-a1ab-4cbf-851b-420beb29dd03 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 19ff8616-8e62-40fe-87e7-f976433b9288] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:46:49.640337 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 134/265] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:49 2022] GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20 => generated 1521 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:49.649565 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-2519328f-a1ab-4cbf-851b-420beb29dd03 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:49.649565 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-2519328f-a1ab-4cbf-851b-420beb29dd03 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:49.649565 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-2519328f-a1ab-4cbf-851b-420beb29dd03 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:49.649870 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-2519328f-a1ab-4cbf-851b-420beb29dd03 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:49.890244 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-2519328f-a1ab-4cbf-851b-420beb29dd03 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a88a8d7c9e4d0a88308c0e894570be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c31bb4f3ce486591bc142b1da7553e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:46:49.901480 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-2519328f-a1ab-4cbf-851b-420beb29dd03 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288" status: 200 len: 1362 microversion: 2.1 time: 0.271296 Apr 08 02:46:49.902022 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 132/266] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:49 2022] GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288 => generated 1362 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:46:50.663408 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-79f7d998-079b-4a02-839f-89dd820a08fc tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:50.664550 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-79f7d998-079b-4a02-839f-89dd820a08fc tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 6228b11f-244d-4e25-8b1f-e19a90cc8c20] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:46:50.671943 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-79f7d998-079b-4a02-839f-89dd820a08fc tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:50.672417 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-79f7d998-079b-4a02-839f-89dd820a08fc tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:50.673186 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-79f7d998-079b-4a02-839f-89dd820a08fc tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:50.673613 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-79f7d998-079b-4a02-839f-89dd820a08fc tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:50.927597 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-a465c4db-59a9-4ae7-8341-f910cbbe5e47 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:50.928729 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-a465c4db-59a9-4ae7-8341-f910cbbe5e47 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 19ff8616-8e62-40fe-87e7-f976433b9288] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:46:50.937394 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-a465c4db-59a9-4ae7-8341-f910cbbe5e47 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:50.939014 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-a465c4db-59a9-4ae7-8341-f910cbbe5e47 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:50.940203 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-a465c4db-59a9-4ae7-8341-f910cbbe5e47 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:50.940892 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-a465c4db-59a9-4ae7-8341-f910cbbe5e47 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:50.951808 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-79f7d998-079b-4a02-839f-89dd820a08fc tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:46:50.961974 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-79f7d998-079b-4a02-839f-89dd820a08fc tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20" status: 200 len: 1501 microversion: 2.1 time: 0.308806 Apr 08 02:46:50.970277 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 135/267] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:50 2022] GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20 => generated 1501 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:51.004701 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-eb83725f-3723-4820-b879-775c08d92fe2 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:51.005623 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-eb83725f-3723-4820-b879-775c08d92fe2 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: fe2c4fd0-315a-4d94-8913-a661cdfa293a] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:46:51.013749 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-eb83725f-3723-4820-b879-775c08d92fe2 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:51.014435 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-eb83725f-3723-4820-b879-775c08d92fe2 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:51.015647 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-eb83725f-3723-4820-b879-775c08d92fe2 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:51.016466 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-eb83725f-3723-4820-b879-775c08d92fe2 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:51.257185 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-a465c4db-59a9-4ae7-8341-f910cbbe5e47 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a88a8d7c9e4d0a88308c0e894570be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c31bb4f3ce486591bc142b1da7553e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:46:51.267598 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-a465c4db-59a9-4ae7-8341-f910cbbe5e47 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288" status: 200 len: 1362 microversion: 2.1 time: 0.352600 Apr 08 02:46:51.268844 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 133/268] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:50 2022] GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288 => generated 1362 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:51.349000 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-eb83725f-3723-4820-b879-775c08d92fe2 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:46:51.362762 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-eb83725f-3723-4820-b879-775c08d92fe2 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/fe2c4fd0-315a-4d94-8913-a661cdfa293a" status: 200 len: 1514 microversion: 2.1 time: 0.380291 Apr 08 02:46:51.363574 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 136/269] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:50 2022] GET /compute/v2.1/servers/fe2c4fd0-315a-4d94-8913-a661cdfa293a => generated 1514 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:52.291558 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-66b80a24-1bc2-4392-8c7c-87c62ec664b0 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:52.293215 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-66b80a24-1bc2-4392-8c7c-87c62ec664b0 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 19ff8616-8e62-40fe-87e7-f976433b9288] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:46:52.301188 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-66b80a24-1bc2-4392-8c7c-87c62ec664b0 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:52.302057 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-66b80a24-1bc2-4392-8c7c-87c62ec664b0 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:52.303984 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-66b80a24-1bc2-4392-8c7c-87c62ec664b0 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:52.304601 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-66b80a24-1bc2-4392-8c7c-87c62ec664b0 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:52.580884 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-66b80a24-1bc2-4392-8c7c-87c62ec664b0 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a88a8d7c9e4d0a88308c0e894570be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c31bb4f3ce486591bc142b1da7553e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:46:52.595191 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-66b80a24-1bc2-4392-8c7c-87c62ec664b0 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288" status: 200 len: 1362 microversion: 2.1 time: 0.314119 Apr 08 02:46:52.596796 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 134/270] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:52 2022] GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288 => generated 1362 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:52.839137 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [req-fac15333-48be-42ad-9a69-31cab7ceb14b req-5f8c57ab-90fa-4613-8016-d70d69fe1b3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19ff8616-8e62-40fe-87e7-f976433b9288", "name": "network-vif-plugged", "status": "completed", "tag": "13eae4a8-fba8-4afe-8767-4b3ffface99b"}]} {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:46:52.849354 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:46:52.849354 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: warnings.warn(msg) Apr 08 02:46:52.862488 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-fac15333-48be-42ad-9a69-31cab7ceb14b req-5f8c57ab-90fa-4613-8016-d70d69fe1b3b service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:52.863191 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-fac15333-48be-42ad-9a69-31cab7ceb14b req-5f8c57ab-90fa-4613-8016-d70d69fe1b3b service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:52.883334 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.compute.server_external_events [req-fac15333-48be-42ad-9a69-31cab7ceb14b req-5f8c57ab-90fa-4613-8016-d70d69fe1b3b service nova] Creating event network-vif-plugged:13eae4a8-fba8-4afe-8767-4b3ffface99b for instance 19ff8616-8e62-40fe-87e7-f976433b9288 on hv-cinder-83705 Apr 08 02:46:52.888744 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [req-fac15333-48be-42ad-9a69-31cab7ceb14b req-5f8c57ab-90fa-4613-8016-d70d69fe1b3b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067631 Apr 08 02:46:52.890183 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 137/271] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:46:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:46:53.050137 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-4cfa2ac3-ff55-4312-a541-410152e0060d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:46:53.051447 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-4cfa2ac3-ff55-4312-a541-410152e0060d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: fe2c4fd0-315a-4d94-8913-a661cdfa293a] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:46:53.069380 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-4cfa2ac3-ff55-4312-a541-410152e0060d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:53.069900 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-4cfa2ac3-ff55-4312-a541-410152e0060d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:53.071554 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-4cfa2ac3-ff55-4312-a541-410152e0060d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:53.072464 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-4cfa2ac3-ff55-4312-a541-410152e0060d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:53.164148 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.objects.instance [None req-4cfa2ac3-ff55-4312-a541-410152e0060d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lazy-loading 'flavor' on Instance uuid fe2c4fd0-315a-4d94-8913-a661cdfa293a {{(pid=96919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 08 02:46:53.386476 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-4cfa2ac3-ff55-4312-a541-410152e0060d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "POST /compute/v2.1/servers/fe2c4fd0-315a-4d94-8913-a661cdfa293a/action" status: 200 len: 32 microversion: 2.1 time: 0.350939 Apr 08 02:46:53.388045 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 135/272] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Apr 8 02:46:53 2022] POST /compute/v2.1/servers/fe2c4fd0-315a-4d94-8913-a661cdfa293a/action => generated 32 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 08 02:46:53.405967 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-631dfe55-47cb-47f9-a6d1-2f4e1cfd17c4 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:53.407803 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-631dfe55-47cb-47f9-a6d1-2f4e1cfd17c4 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: fe2c4fd0-315a-4d94-8913-a661cdfa293a] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:46:53.416375 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-631dfe55-47cb-47f9-a6d1-2f4e1cfd17c4 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:53.417082 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-631dfe55-47cb-47f9-a6d1-2f4e1cfd17c4 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:53.418007 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-631dfe55-47cb-47f9-a6d1-2f4e1cfd17c4 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:53.418601 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-631dfe55-47cb-47f9-a6d1-2f4e1cfd17c4 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:53.630011 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-45a9878b-165b-4f05-9abb-06f2e66ad0b6 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:53.630994 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-45a9878b-165b-4f05-9abb-06f2e66ad0b6 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 19ff8616-8e62-40fe-87e7-f976433b9288] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:46:53.649732 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-45a9878b-165b-4f05-9abb-06f2e66ad0b6 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:53.650392 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-45a9878b-165b-4f05-9abb-06f2e66ad0b6 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:53.653992 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-45a9878b-165b-4f05-9abb-06f2e66ad0b6 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:53.654638 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-45a9878b-165b-4f05-9abb-06f2e66ad0b6 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:53.737859 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-631dfe55-47cb-47f9-a6d1-2f4e1cfd17c4 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:46:53.760764 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-631dfe55-47cb-47f9-a6d1-2f4e1cfd17c4 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/fe2c4fd0-315a-4d94-8913-a661cdfa293a" status: 200 len: 1520 microversion: 2.1 time: 0.366274 Apr 08 02:46:53.761859 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 138/273] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:53 2022] GET /compute/v2.1/servers/fe2c4fd0-315a-4d94-8913-a661cdfa293a => generated 1520 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:46:53.946162 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-45a9878b-165b-4f05-9abb-06f2e66ad0b6 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a88a8d7c9e4d0a88308c0e894570be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c31bb4f3ce486591bc142b1da7553e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:46:53.955557 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-45a9878b-165b-4f05-9abb-06f2e66ad0b6 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288" status: 200 len: 1362 microversion: 2.1 time: 0.346954 Apr 08 02:46:53.966279 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 136/274] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:53 2022] GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288 => generated 1362 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:54.787971 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-6027f411-2f0a-4da9-80a2-45cf438e0506 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:54.789136 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-6027f411-2f0a-4da9-80a2-45cf438e0506 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: fe2c4fd0-315a-4d94-8913-a661cdfa293a] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:46:54.798513 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-6027f411-2f0a-4da9-80a2-45cf438e0506 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:54.799365 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-6027f411-2f0a-4da9-80a2-45cf438e0506 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:54.800317 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-6027f411-2f0a-4da9-80a2-45cf438e0506 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:54.800816 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-6027f411-2f0a-4da9-80a2-45cf438e0506 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:54.984971 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-57eda851-c3cb-4cfd-a793-618eb40dce2f tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:54.986201 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-57eda851-c3cb-4cfd-a793-618eb40dce2f tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 19ff8616-8e62-40fe-87e7-f976433b9288] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:46:54.997175 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-57eda851-c3cb-4cfd-a793-618eb40dce2f tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:54.998158 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-57eda851-c3cb-4cfd-a793-618eb40dce2f tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:54.999165 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-57eda851-c3cb-4cfd-a793-618eb40dce2f tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:54.999709 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-57eda851-c3cb-4cfd-a793-618eb40dce2f tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:55.332446 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-6027f411-2f0a-4da9-80a2-45cf438e0506 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:46:55.342105 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-6027f411-2f0a-4da9-80a2-45cf438e0506 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/fe2c4fd0-315a-4d94-8913-a661cdfa293a" status: 200 len: 1520 microversion: 2.1 time: 0.566413 Apr 08 02:46:55.354155 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 139/275] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:54 2022] GET /compute/v2.1/servers/fe2c4fd0-315a-4d94-8913-a661cdfa293a => generated 1520 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:46:55.440785 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-57eda851-c3cb-4cfd-a793-618eb40dce2f tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a88a8d7c9e4d0a88308c0e894570be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c31bb4f3ce486591bc142b1da7553e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:46:55.449242 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-57eda851-c3cb-4cfd-a793-618eb40dce2f tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288" status: 200 len: 1362 microversion: 2.1 time: 0.480550 Apr 08 02:46:55.449726 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 137/276] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:54 2022] GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288 => generated 1362 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:46:56.370113 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-8de663be-8d30-4b07-b15a-e540fe152f8b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:56.370739 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-8de663be-8d30-4b07-b15a-e540fe152f8b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: fe2c4fd0-315a-4d94-8913-a661cdfa293a] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:46:56.383848 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-8de663be-8d30-4b07-b15a-e540fe152f8b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:56.384285 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-8de663be-8d30-4b07-b15a-e540fe152f8b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:56.385065 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-8de663be-8d30-4b07-b15a-e540fe152f8b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:56.385496 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-8de663be-8d30-4b07-b15a-e540fe152f8b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:56.472646 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-31efcb40-1ac0-4ebd-8418-4a6945c207a0 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:56.473314 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-31efcb40-1ac0-4ebd-8418-4a6945c207a0 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 19ff8616-8e62-40fe-87e7-f976433b9288] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:46:56.481696 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-31efcb40-1ac0-4ebd-8418-4a6945c207a0 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:56.482177 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-31efcb40-1ac0-4ebd-8418-4a6945c207a0 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:56.482950 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-31efcb40-1ac0-4ebd-8418-4a6945c207a0 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:56.483537 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-31efcb40-1ac0-4ebd-8418-4a6945c207a0 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:56.757773 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-8de663be-8d30-4b07-b15a-e540fe152f8b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:46:56.769864 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-8de663be-8d30-4b07-b15a-e540fe152f8b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/fe2c4fd0-315a-4d94-8913-a661cdfa293a" status: 200 len: 1520 microversion: 2.1 time: 0.409002 Apr 08 02:46:56.782298 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 140/277] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:56 2022] GET /compute/v2.1/servers/fe2c4fd0-315a-4d94-8913-a661cdfa293a => generated 1520 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:56.920279 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-31efcb40-1ac0-4ebd-8418-4a6945c207a0 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a88a8d7c9e4d0a88308c0e894570be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c31bb4f3ce486591bc142b1da7553e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:46:56.932726 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-31efcb40-1ac0-4ebd-8418-4a6945c207a0 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288" status: 200 len: 1548 microversion: 2.1 time: 0.469343 Apr 08 02:46:56.976002 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 138/278] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:56 2022] GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288 => generated 1548 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:46:56.981662 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-8d32262b-b36f-44f1-bc11-0e40308ff012 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:56.982245 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-8d32262b-b36f-44f1-bc11-0e40308ff012 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 19ff8616-8e62-40fe-87e7-f976433b9288] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:46:56.999321 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-8d32262b-b36f-44f1-bc11-0e40308ff012 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:57.000395 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-8d32262b-b36f-44f1-bc11-0e40308ff012 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:57.002677 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-8d32262b-b36f-44f1-bc11-0e40308ff012 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:57.004972 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-8d32262b-b36f-44f1-bc11-0e40308ff012 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:57.221710 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-8d32262b-b36f-44f1-bc11-0e40308ff012 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.274909 Apr 08 02:46:57.222356 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 141/279] 10.222.0.48 () {58 vars in 1274 bytes} [Fri Apr 8 02:46:56 2022] GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288/os-interface => generated 284 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:46:57.802417 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-17e13b4f-dc75-4f69-8ae7-985d81e5443d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:57.803068 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-17e13b4f-dc75-4f69-8ae7-985d81e5443d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: fe2c4fd0-315a-4d94-8913-a661cdfa293a] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:46:57.814508 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-17e13b4f-dc75-4f69-8ae7-985d81e5443d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:57.815083 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-17e13b4f-dc75-4f69-8ae7-985d81e5443d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:57.815872 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-17e13b4f-dc75-4f69-8ae7-985d81e5443d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:57.816304 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-17e13b4f-dc75-4f69-8ae7-985d81e5443d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:58.488368 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-17e13b4f-dc75-4f69-8ae7-985d81e5443d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:46:58.497125 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-17e13b4f-dc75-4f69-8ae7-985d81e5443d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/fe2c4fd0-315a-4d94-8913-a661cdfa293a" status: 200 len: 1520 microversion: 2.1 time: 0.712564 Apr 08 02:46:58.508774 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 139/280] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:57 2022] GET /compute/v2.1/servers/fe2c4fd0-315a-4d94-8913-a661cdfa293a => generated 1520 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:46:59.523931 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-18fd8780-1a1a-4d0c-9dd2-458a06aa75e0 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:46:59.525689 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-18fd8780-1a1a-4d0c-9dd2-458a06aa75e0 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: fe2c4fd0-315a-4d94-8913-a661cdfa293a] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:46:59.540197 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-18fd8780-1a1a-4d0c-9dd2-458a06aa75e0 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:59.540641 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-18fd8780-1a1a-4d0c-9dd2-458a06aa75e0 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:59.541412 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-18fd8780-1a1a-4d0c-9dd2-458a06aa75e0 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:46:59.541828 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-18fd8780-1a1a-4d0c-9dd2-458a06aa75e0 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:46:59.866342 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-3293470f-8b6d-4728-8dd7-e7706b16d821 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1930839597", "imageRef": "7f8ca061-f382-4052-8d05-69f37e107684", "flavorRef": "452", "networks": [{"uuid": "56fa5162-5751-457a-9e46-87c248750bb3"}]}} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:46:59.993513 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.network.neutron [None req-3293470f-8b6d-4728-8dd7-e7706b16d821 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] validate_networks() for [('56fa5162-5751-457a-9e46-87c248750bb3', None, None, None)] {{(pid=96919) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} Apr 08 02:47:00.160048 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-18fd8780-1a1a-4d0c-9dd2-458a06aa75e0 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:47:00.171168 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-18fd8780-1a1a-4d0c-9dd2-458a06aa75e0 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/fe2c4fd0-315a-4d94-8913-a661cdfa293a" status: 200 len: 1520 microversion: 2.1 time: 0.659511 Apr 08 02:47:00.173276 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 142/281] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:46:59 2022] GET /compute/v2.1/servers/fe2c4fd0-315a-4d94-8913-a661cdfa293a => generated 1520 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:47:00.186163 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [req-7a0a4151-dca9-46ab-adea-7d839e26f3b4 req-09352002-76d3-4bc1-934f-bb3df3c15295 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19ff8616-8e62-40fe-87e7-f976433b9288", "tag": "13eae4a8-fba8-4afe-8767-4b3ffface99b"}]} {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:47:00.193458 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:47:00.193458 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: warnings.warn(msg) Apr 08 02:47:00.204401 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-7a0a4151-dca9-46ab-adea-7d839e26f3b4 req-09352002-76d3-4bc1-934f-bb3df3c15295 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:00.205252 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-7a0a4151-dca9-46ab-adea-7d839e26f3b4 req-09352002-76d3-4bc1-934f-bb3df3c15295 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:00.226095 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.compute.server_external_events [req-7a0a4151-dca9-46ab-adea-7d839e26f3b4 req-09352002-76d3-4bc1-934f-bb3df3c15295 service nova] Creating event network-changed:13eae4a8-fba8-4afe-8767-4b3ffface99b for instance 19ff8616-8e62-40fe-87e7-f976433b9288 on hv-cinder-83705 Apr 08 02:47:00.231373 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [req-7a0a4151-dca9-46ab-adea-7d839e26f3b4 req-09352002-76d3-4bc1-934f-bb3df3c15295 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056683 Apr 08 02:47:00.237063 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 143/282] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:47:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:47:00.768257 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.virt.hardware [None req-3293470f-8b6d-4728-8dd7-e7706b16d821 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Flavor limits 0:0:0 {{(pid=96919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} Apr 08 02:47:00.768869 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.virt.hardware [None req-3293470f-8b6d-4728-8dd7-e7706b16d821 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Image limits 0:0:0 {{(pid=96919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} Apr 08 02:47:00.769447 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.virt.hardware [None req-3293470f-8b6d-4728-8dd7-e7706b16d821 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Flavor pref 0:0:0 {{(pid=96919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} Apr 08 02:47:00.769885 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.virt.hardware [None req-3293470f-8b6d-4728-8dd7-e7706b16d821 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Image pref 0:0:0 {{(pid=96919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} Apr 08 02:47:00.770287 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.virt.hardware [None req-3293470f-8b6d-4728-8dd7-e7706b16d821 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=96919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} Apr 08 02:47:00.779160 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-3293470f-8b6d-4728-8dd7-e7706b16d821 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:00.779787 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-3293470f-8b6d-4728-8dd7-e7706b16d821 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:00.780872 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-3293470f-8b6d-4728-8dd7-e7706b16d821 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:00.782095 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-3293470f-8b6d-4728-8dd7-e7706b16d821 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:00.802091 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.quota [None req-3293470f-8b6d-4728-8dd7-e7706b16d821 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Getting quotas for project 5fb44db14d6e4c14b82c05f28e8ee9d9. Resources: {'instances', 'cores', 'ram'} {{(pid=96919) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:47:00.823184 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.quota [None req-3293470f-8b6d-4728-8dd7-e7706b16d821 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Getting quotas for user 6b94017d79f24adaa76748899bc7c014 and project 5fb44db14d6e4c14b82c05f28e8ee9d9. Resources: {'instances', 'cores', 'ram'} {{(pid=96919) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:47:00.850247 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-3293470f-8b6d-4728-8dd7-e7706b16d821 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Going to run 1 instances... {{(pid=96919) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} Apr 08 02:47:00.853807 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-3293470f-8b6d-4728-8dd7-e7706b16d821 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] [instance: 8a8be830-80b6-459a-a34e-e19f4b587222] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7f8ca061-f382-4052-8d05-69f37e107684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=96919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} Apr 08 02:47:00.967798 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-3293470f-8b6d-4728-8dd7-e7706b16d821 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.110205 Apr 08 02:47:00.969303 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 140/283] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Apr 8 02:46:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1113 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 08 02:47:00.990292 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-f96a275a-58ae-42d8-af3e-490bcf605055 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:01.003509 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-f96a275a-58ae-42d8-af3e-490bcf605055 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] [instance: 8a8be830-80b6-459a-a34e-e19f4b587222] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:47:01.167207 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-f96a275a-58ae-42d8-af3e-490bcf605055 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94017d79f24adaa76748899bc7c014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fb44db14d6e4c14b82c05f28e8ee9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:47:01.197948 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-f96a275a-58ae-42d8-af3e-490bcf605055 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] 10.222.0.48 "GET /compute/v2.1/servers/8a8be830-80b6-459a-a34e-e19f4b587222" status: 200 len: 1219 microversion: 2.1 time: 0.221838 Apr 08 02:47:01.199560 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-064fb511-a3f0-45ac-bf8b-72a77804c387 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:01.200089 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 144/284] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:00 2022] GET /compute/v2.1/servers/8a8be830-80b6-459a-a34e-e19f4b587222 => generated 1219 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:47:01.200842 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-064fb511-a3f0-45ac-bf8b-72a77804c387 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: fe2c4fd0-315a-4d94-8913-a661cdfa293a] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:47:01.210463 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-064fb511-a3f0-45ac-bf8b-72a77804c387 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:01.211118 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-064fb511-a3f0-45ac-bf8b-72a77804c387 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:01.212043 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-064fb511-a3f0-45ac-bf8b-72a77804c387 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:01.212756 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-064fb511-a3f0-45ac-bf8b-72a77804c387 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:01.510599 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-064fb511-a3f0-45ac-bf8b-72a77804c387 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:47:01.522574 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-064fb511-a3f0-45ac-bf8b-72a77804c387 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/fe2c4fd0-315a-4d94-8913-a661cdfa293a" status: 200 len: 1520 microversion: 2.1 time: 0.336205 Apr 08 02:47:01.523955 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 141/285] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:01 2022] GET /compute/v2.1/servers/fe2c4fd0-315a-4d94-8913-a661cdfa293a => generated 1520 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:47:02.222476 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-10edd112-c0ac-4b2c-86d4-77374c9c74ec tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:02.223145 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-10edd112-c0ac-4b2c-86d4-77374c9c74ec tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] [instance: 8a8be830-80b6-459a-a34e-e19f4b587222] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:47:02.231455 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-10edd112-c0ac-4b2c-86d4-77374c9c74ec tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:02.231908 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-10edd112-c0ac-4b2c-86d4-77374c9c74ec tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:02.232681 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-10edd112-c0ac-4b2c-86d4-77374c9c74ec tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:02.233116 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-10edd112-c0ac-4b2c-86d4-77374c9c74ec tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:02.356632 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-10edd112-c0ac-4b2c-86d4-77374c9c74ec tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94017d79f24adaa76748899bc7c014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fb44db14d6e4c14b82c05f28e8ee9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:47:02.365306 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-10edd112-c0ac-4b2c-86d4-77374c9c74ec tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] 10.222.0.48 "GET /compute/v2.1/servers/8a8be830-80b6-459a-a34e-e19f4b587222" status: 200 len: 1223 microversion: 2.1 time: 0.151907 Apr 08 02:47:02.365933 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 145/286] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:02 2022] GET /compute/v2.1/servers/8a8be830-80b6-459a-a34e-e19f4b587222 => generated 1223 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:47:02.547351 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-6cd60ab8-7b99-429b-94b2-4ee432b73430 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:02.548127 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-6cd60ab8-7b99-429b-94b2-4ee432b73430 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: fe2c4fd0-315a-4d94-8913-a661cdfa293a] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:47:02.555477 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-6cd60ab8-7b99-429b-94b2-4ee432b73430 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:02.555916 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-6cd60ab8-7b99-429b-94b2-4ee432b73430 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:02.556683 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-6cd60ab8-7b99-429b-94b2-4ee432b73430 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:02.557110 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-6cd60ab8-7b99-429b-94b2-4ee432b73430 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:02.762184 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-6cd60ab8-7b99-429b-94b2-4ee432b73430 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:47:02.770963 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-6cd60ab8-7b99-429b-94b2-4ee432b73430 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/fe2c4fd0-315a-4d94-8913-a661cdfa293a" status: 200 len: 1520 microversion: 2.1 time: 0.234417 Apr 08 02:47:02.771501 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 142/287] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:02 2022] GET /compute/v2.1/servers/fe2c4fd0-315a-4d94-8913-a661cdfa293a => generated 1520 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:47:03.386944 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-4d9a806a-5b4f-47bc-8abd-ac122fd74fa7 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:03.387539 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-4d9a806a-5b4f-47bc-8abd-ac122fd74fa7 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] [instance: 8a8be830-80b6-459a-a34e-e19f4b587222] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:47:03.399532 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-4d9a806a-5b4f-47bc-8abd-ac122fd74fa7 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:03.399979 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-4d9a806a-5b4f-47bc-8abd-ac122fd74fa7 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:03.400747 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-4d9a806a-5b4f-47bc-8abd-ac122fd74fa7 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:03.401172 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-4d9a806a-5b4f-47bc-8abd-ac122fd74fa7 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:03.522054 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-4d9a806a-5b4f-47bc-8abd-ac122fd74fa7 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94017d79f24adaa76748899bc7c014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fb44db14d6e4c14b82c05f28e8ee9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:47:03.529879 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-4d9a806a-5b4f-47bc-8abd-ac122fd74fa7 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] 10.222.0.48 "GET /compute/v2.1/servers/8a8be830-80b6-459a-a34e-e19f4b587222" status: 200 len: 1215 microversion: 2.1 time: 0.151830 Apr 08 02:47:03.530542 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 146/288] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:03 2022] GET /compute/v2.1/servers/8a8be830-80b6-459a-a34e-e19f4b587222 => generated 1215 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:47:03.793606 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-a6bba2b6-53df-486e-aedd-69d07a74ec83 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:03.794218 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-a6bba2b6-53df-486e-aedd-69d07a74ec83 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: fe2c4fd0-315a-4d94-8913-a661cdfa293a] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:47:03.803005 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-a6bba2b6-53df-486e-aedd-69d07a74ec83 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:03.803449 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-a6bba2b6-53df-486e-aedd-69d07a74ec83 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:03.804229 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-a6bba2b6-53df-486e-aedd-69d07a74ec83 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:03.804654 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-a6bba2b6-53df-486e-aedd-69d07a74ec83 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:04.123801 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-a6bba2b6-53df-486e-aedd-69d07a74ec83 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:47:04.132553 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-a6bba2b6-53df-486e-aedd-69d07a74ec83 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/fe2c4fd0-315a-4d94-8913-a661cdfa293a" status: 200 len: 1520 microversion: 2.1 time: 0.348346 Apr 08 02:47:04.133080 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 143/289] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:03 2022] GET /compute/v2.1/servers/fe2c4fd0-315a-4d94-8913-a661cdfa293a => generated 1520 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:47:04.554784 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-2ba1fc2e-eebf-4c33-99d1-5f44f65cca72 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:04.555989 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-2ba1fc2e-eebf-4c33-99d1-5f44f65cca72 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] [instance: 8a8be830-80b6-459a-a34e-e19f4b587222] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:47:04.563438 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-2ba1fc2e-eebf-4c33-99d1-5f44f65cca72 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:04.564009 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-2ba1fc2e-eebf-4c33-99d1-5f44f65cca72 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:04.564929 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-2ba1fc2e-eebf-4c33-99d1-5f44f65cca72 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:04.565506 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-2ba1fc2e-eebf-4c33-99d1-5f44f65cca72 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:04.695916 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-2ba1fc2e-eebf-4c33-99d1-5f44f65cca72 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94017d79f24adaa76748899bc7c014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fb44db14d6e4c14b82c05f28e8ee9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:47:04.704359 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-2ba1fc2e-eebf-4c33-99d1-5f44f65cca72 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] 10.222.0.48 "GET /compute/v2.1/servers/8a8be830-80b6-459a-a34e-e19f4b587222" status: 200 len: 1271 microversion: 2.1 time: 0.159516 Apr 08 02:47:04.704892 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 147/290] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:04 2022] GET /compute/v2.1/servers/8a8be830-80b6-459a-a34e-e19f4b587222 => generated 1271 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:47:05.156426 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-31b97552-a7cc-4467-a4ea-fde9c1c9cfda tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:05.156985 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-31b97552-a7cc-4467-a4ea-fde9c1c9cfda tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: fe2c4fd0-315a-4d94-8913-a661cdfa293a] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:47:05.173195 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-31b97552-a7cc-4467-a4ea-fde9c1c9cfda tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:05.173955 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-31b97552-a7cc-4467-a4ea-fde9c1c9cfda tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:05.175587 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-31b97552-a7cc-4467-a4ea-fde9c1c9cfda tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:05.176380 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-31b97552-a7cc-4467-a4ea-fde9c1c9cfda tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:05.405923 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-31b97552-a7cc-4467-a4ea-fde9c1c9cfda tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:47:05.414841 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-31b97552-a7cc-4467-a4ea-fde9c1c9cfda tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/fe2c4fd0-315a-4d94-8913-a661cdfa293a" status: 200 len: 1520 microversion: 2.1 time: 0.269162 Apr 08 02:47:05.415399 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 144/291] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:05 2022] GET /compute/v2.1/servers/fe2c4fd0-315a-4d94-8913-a661cdfa293a => generated 1520 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:47:05.726747 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-044651d1-55b0-4c33-8a02-e2f6c8b15d11 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:05.727350 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-044651d1-55b0-4c33-8a02-e2f6c8b15d11 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] [instance: 8a8be830-80b6-459a-a34e-e19f4b587222] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:47:05.734659 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-044651d1-55b0-4c33-8a02-e2f6c8b15d11 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:05.735300 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-044651d1-55b0-4c33-8a02-e2f6c8b15d11 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:05.736155 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-044651d1-55b0-4c33-8a02-e2f6c8b15d11 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:05.736676 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-044651d1-55b0-4c33-8a02-e2f6c8b15d11 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:05.974768 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-044651d1-55b0-4c33-8a02-e2f6c8b15d11 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94017d79f24adaa76748899bc7c014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fb44db14d6e4c14b82c05f28e8ee9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:47:05.983647 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-044651d1-55b0-4c33-8a02-e2f6c8b15d11 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] 10.222.0.48 "GET /compute/v2.1/servers/8a8be830-80b6-459a-a34e-e19f4b587222" status: 200 len: 1319 microversion: 2.1 time: 0.266398 Apr 08 02:47:05.993809 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 148/292] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:05 2022] GET /compute/v2.1/servers/8a8be830-80b6-459a-a34e-e19f4b587222 => generated 1319 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:47:06.438770 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-a5aa99db-a64e-414b-9cd4-875bdcbf373c tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:06.439484 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-a5aa99db-a64e-414b-9cd4-875bdcbf373c tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: fe2c4fd0-315a-4d94-8913-a661cdfa293a] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:47:06.447061 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-a5aa99db-a64e-414b-9cd4-875bdcbf373c tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:06.447508 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-a5aa99db-a64e-414b-9cd4-875bdcbf373c tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:06.448331 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-a5aa99db-a64e-414b-9cd4-875bdcbf373c tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:06.448760 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-a5aa99db-a64e-414b-9cd4-875bdcbf373c tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:06.700175 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-a5aa99db-a64e-414b-9cd4-875bdcbf373c tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:47:06.710775 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-a5aa99db-a64e-414b-9cd4-875bdcbf373c tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/fe2c4fd0-315a-4d94-8913-a661cdfa293a" status: 200 len: 1520 microversion: 2.1 time: 0.282825 Apr 08 02:47:06.711667 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 145/293] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:06 2022] GET /compute/v2.1/servers/fe2c4fd0-315a-4d94-8913-a661cdfa293a => generated 1520 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:47:06.941217 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [req-4dc8b965-9fa9-485b-be38-e95299c93174 req-46d802d3-d466-4f00-ba53-332eebfa6ee2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a8be830-80b6-459a-a34e-e19f4b587222", "tag": "81ce21ba-cf6f-417d-ac71-eb07f357b4af"}]} {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:47:06.948706 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:47:06.948706 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: warnings.warn(msg) Apr 08 02:47:06.958189 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-4dc8b965-9fa9-485b-be38-e95299c93174 req-46d802d3-d466-4f00-ba53-332eebfa6ee2 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:06.958809 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-4dc8b965-9fa9-485b-be38-e95299c93174 req-46d802d3-d466-4f00-ba53-332eebfa6ee2 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:06.985867 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.compute.server_external_events [req-4dc8b965-9fa9-485b-be38-e95299c93174 req-46d802d3-d466-4f00-ba53-332eebfa6ee2 service nova] Creating event network-changed:81ce21ba-cf6f-417d-ac71-eb07f357b4af for instance 8a8be830-80b6-459a-a34e-e19f4b587222 on hv-cinder-83705 Apr 08 02:47:06.992227 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [req-4dc8b965-9fa9-485b-be38-e95299c93174 req-46d802d3-d466-4f00-ba53-332eebfa6ee2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059783 Apr 08 02:47:06.993211 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 149/294] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:47:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:47:07.007360 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-02b03f83-093c-422f-92ce-a7624fd60cbb tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:07.008254 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-02b03f83-093c-422f-92ce-a7624fd60cbb tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] [instance: 8a8be830-80b6-459a-a34e-e19f4b587222] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:47:07.018048 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-02b03f83-093c-422f-92ce-a7624fd60cbb tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:07.018922 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-02b03f83-093c-422f-92ce-a7624fd60cbb tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:07.020334 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-02b03f83-093c-422f-92ce-a7624fd60cbb tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:07.021317 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-02b03f83-093c-422f-92ce-a7624fd60cbb tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:07.253720 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-02b03f83-093c-422f-92ce-a7624fd60cbb tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94017d79f24adaa76748899bc7c014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fb44db14d6e4c14b82c05f28e8ee9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:47:07.263989 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-02b03f83-093c-422f-92ce-a7624fd60cbb tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] 10.222.0.48 "GET /compute/v2.1/servers/8a8be830-80b6-459a-a34e-e19f4b587222" status: 200 len: 1319 microversion: 2.1 time: 0.267058 Apr 08 02:47:07.264534 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 146/295] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:06 2022] GET /compute/v2.1/servers/8a8be830-80b6-459a-a34e-e19f4b587222 => generated 1319 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:47:07.735153 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-3e3c4ddb-cd11-415e-a52f-bae360566dd7 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:07.736150 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-3e3c4ddb-cd11-415e-a52f-bae360566dd7 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: fe2c4fd0-315a-4d94-8913-a661cdfa293a] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:47:07.744516 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-3e3c4ddb-cd11-415e-a52f-bae360566dd7 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:07.745129 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-3e3c4ddb-cd11-415e-a52f-bae360566dd7 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:07.746076 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-3e3c4ddb-cd11-415e-a52f-bae360566dd7 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:07.746654 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-3e3c4ddb-cd11-415e-a52f-bae360566dd7 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:08.003170 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-3e3c4ddb-cd11-415e-a52f-bae360566dd7 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:47:08.013824 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-3e3c4ddb-cd11-415e-a52f-bae360566dd7 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/fe2c4fd0-315a-4d94-8913-a661cdfa293a" status: 200 len: 1520 microversion: 2.1 time: 0.288942 Apr 08 02:47:08.016630 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 150/296] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:07 2022] GET /compute/v2.1/servers/fe2c4fd0-315a-4d94-8913-a661cdfa293a => generated 1520 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:47:08.287165 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-9c5dc959-f40b-43bc-90ba-009301d27d5d tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:08.287710 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-9c5dc959-f40b-43bc-90ba-009301d27d5d tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] [instance: 8a8be830-80b6-459a-a34e-e19f4b587222] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:47:08.294902 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-9c5dc959-f40b-43bc-90ba-009301d27d5d tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:08.295347 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-9c5dc959-f40b-43bc-90ba-009301d27d5d tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:08.296115 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-9c5dc959-f40b-43bc-90ba-009301d27d5d tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:08.297272 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-9c5dc959-f40b-43bc-90ba-009301d27d5d tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:08.504179 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-9c5dc959-f40b-43bc-90ba-009301d27d5d tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94017d79f24adaa76748899bc7c014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fb44db14d6e4c14b82c05f28e8ee9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:47:08.512187 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-9c5dc959-f40b-43bc-90ba-009301d27d5d tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] 10.222.0.48 "GET /compute/v2.1/servers/8a8be830-80b6-459a-a34e-e19f4b587222" status: 200 len: 1319 microversion: 2.1 time: 0.234713 Apr 08 02:47:08.512723 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 147/297] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:08 2022] GET /compute/v2.1/servers/8a8be830-80b6-459a-a34e-e19f4b587222 => generated 1319 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:47:09.037870 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-63852fc8-ff91-408e-8f2e-c9b3fe0ef6a6 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:09.038466 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-63852fc8-ff91-408e-8f2e-c9b3fe0ef6a6 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: fe2c4fd0-315a-4d94-8913-a661cdfa293a] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:47:09.045644 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-63852fc8-ff91-408e-8f2e-c9b3fe0ef6a6 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:09.046086 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-63852fc8-ff91-408e-8f2e-c9b3fe0ef6a6 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:09.047186 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-63852fc8-ff91-408e-8f2e-c9b3fe0ef6a6 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:09.047615 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-63852fc8-ff91-408e-8f2e-c9b3fe0ef6a6 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:09.262514 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-63852fc8-ff91-408e-8f2e-c9b3fe0ef6a6 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:47:09.272588 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-63852fc8-ff91-408e-8f2e-c9b3fe0ef6a6 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/fe2c4fd0-315a-4d94-8913-a661cdfa293a" status: 200 len: 1520 microversion: 2.1 time: 0.243869 Apr 08 02:47:09.273298 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 151/298] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:09 2022] GET /compute/v2.1/servers/fe2c4fd0-315a-4d94-8913-a661cdfa293a => generated 1520 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:47:09.535459 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-8c983b46-920f-485c-98ad-61330e306168 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:09.536132 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-8c983b46-920f-485c-98ad-61330e306168 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] [instance: 8a8be830-80b6-459a-a34e-e19f4b587222] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:47:09.543476 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-8c983b46-920f-485c-98ad-61330e306168 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:09.543916 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-8c983b46-920f-485c-98ad-61330e306168 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:09.544682 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-8c983b46-920f-485c-98ad-61330e306168 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:09.545102 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-8c983b46-920f-485c-98ad-61330e306168 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:09.792834 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-8c983b46-920f-485c-98ad-61330e306168 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94017d79f24adaa76748899bc7c014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fb44db14d6e4c14b82c05f28e8ee9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:47:09.801428 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-8c983b46-920f-485c-98ad-61330e306168 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] 10.222.0.48 "GET /compute/v2.1/servers/8a8be830-80b6-459a-a34e-e19f4b587222" status: 200 len: 1319 microversion: 2.1 time: 0.275590 Apr 08 02:47:09.801949 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 148/299] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:09 2022] GET /compute/v2.1/servers/8a8be830-80b6-459a-a34e-e19f4b587222 => generated 1319 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:47:10.295414 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-5c23ef6f-dadd-478e-9fdf-fa254b306338 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:10.296117 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-5c23ef6f-dadd-478e-9fdf-fa254b306338 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: fe2c4fd0-315a-4d94-8913-a661cdfa293a] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:47:10.303603 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-5c23ef6f-dadd-478e-9fdf-fa254b306338 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:10.304117 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-5c23ef6f-dadd-478e-9fdf-fa254b306338 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:10.304953 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-5c23ef6f-dadd-478e-9fdf-fa254b306338 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:10.305442 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-5c23ef6f-dadd-478e-9fdf-fa254b306338 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:10.540997 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-5c23ef6f-dadd-478e-9fdf-fa254b306338 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:47:10.550002 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-5c23ef6f-dadd-478e-9fdf-fa254b306338 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/fe2c4fd0-315a-4d94-8913-a661cdfa293a" status: 200 len: 1520 microversion: 2.1 time: 0.263578 Apr 08 02:47:10.550679 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 152/300] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:10 2022] GET /compute/v2.1/servers/fe2c4fd0-315a-4d94-8913-a661cdfa293a => generated 1520 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:47:10.823942 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-b8bcb427-e79b-4987-8e42-d3382eb3bed3 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:10.824436 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-b8bcb427-e79b-4987-8e42-d3382eb3bed3 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] [instance: 8a8be830-80b6-459a-a34e-e19f4b587222] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:47:10.831501 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b8bcb427-e79b-4987-8e42-d3382eb3bed3 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:10.831938 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b8bcb427-e79b-4987-8e42-d3382eb3bed3 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:10.832691 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b8bcb427-e79b-4987-8e42-d3382eb3bed3 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:10.833114 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b8bcb427-e79b-4987-8e42-d3382eb3bed3 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:11.040614 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-b8bcb427-e79b-4987-8e42-d3382eb3bed3 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94017d79f24adaa76748899bc7c014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fb44db14d6e4c14b82c05f28e8ee9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:47:11.049802 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-b8bcb427-e79b-4987-8e42-d3382eb3bed3 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] 10.222.0.48 "GET /compute/v2.1/servers/8a8be830-80b6-459a-a34e-e19f4b587222" status: 200 len: 1319 microversion: 2.1 time: 0.234874 Apr 08 02:47:11.050344 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 149/301] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:10 2022] GET /compute/v2.1/servers/8a8be830-80b6-459a-a34e-e19f4b587222 => generated 1319 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:47:11.573324 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-861c2fa3-f9e6-4b03-b0cd-2bfc094d4579 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:11.573927 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-861c2fa3-f9e6-4b03-b0cd-2bfc094d4579 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: fe2c4fd0-315a-4d94-8913-a661cdfa293a] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:47:11.581388 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-861c2fa3-f9e6-4b03-b0cd-2bfc094d4579 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:11.581903 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-861c2fa3-f9e6-4b03-b0cd-2bfc094d4579 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:11.592153 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-861c2fa3-f9e6-4b03-b0cd-2bfc094d4579 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:11.592153 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-861c2fa3-f9e6-4b03-b0cd-2bfc094d4579 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:11.814398 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-861c2fa3-f9e6-4b03-b0cd-2bfc094d4579 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:47:11.823704 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-861c2fa3-f9e6-4b03-b0cd-2bfc094d4579 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/fe2c4fd0-315a-4d94-8913-a661cdfa293a" status: 200 len: 1500 microversion: 2.1 time: 0.259695 Apr 08 02:47:11.837051 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 153/302] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:11 2022] GET /compute/v2.1/servers/fe2c4fd0-315a-4d94-8913-a661cdfa293a => generated 1500 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:47:11.847556 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-02cc6949-2719-4324-a24a-72796a0ceca8 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1d48ed3e-9750-4adb-9d6a-1a1c4cc1295b"}} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:47:11.848684 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-02cc6949-2719-4324-a24a-72796a0ceca8 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: fe2c4fd0-315a-4d94-8913-a661cdfa293a] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:47:11.855810 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-02cc6949-2719-4324-a24a-72796a0ceca8 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:11.856362 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-02cc6949-2719-4324-a24a-72796a0ceca8 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:11.857254 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-02cc6949-2719-4324-a24a-72796a0ceca8 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:11.857684 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-02cc6949-2719-4324-a24a-72796a0ceca8 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:11.921755 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.wsgi [None req-02cc6949-2719-4324-a24a-72796a0ceca8 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] HTTP exception thrown: Cannot 'attach_volume' instance fe2c4fd0-315a-4d94-8913-a661cdfa293a while it is in vm_state rescued Apr 08 02:47:11.922350 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-02cc6949-2719-4324-a24a-72796a0ceca8 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Returning 409 to user: Cannot 'attach_volume' instance fe2c4fd0-315a-4d94-8913-a661cdfa293a while it is in vm_state rescued {{(pid=96919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Apr 08 02:47:11.923186 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-02cc6949-2719-4324-a24a-72796a0ceca8 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "POST /compute/v2.1/servers/fe2c4fd0-315a-4d94-8913-a661cdfa293a/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.085434 Apr 08 02:47:11.927234 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 150/303] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Apr 8 02:47:11 2022] POST /compute/v2.1/servers/fe2c4fd0-315a-4d94-8913-a661cdfa293a/os-volume_attachments => generated 152 bytes in 87 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 08 02:47:11.938470 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-1207b97d-6a09-4f48-af57-b3c135a93514 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:47:11.939077 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-1207b97d-6a09-4f48-af57-b3c135a93514 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: fe2c4fd0-315a-4d94-8913-a661cdfa293a] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:47:11.946971 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-1207b97d-6a09-4f48-af57-b3c135a93514 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:11.947411 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-1207b97d-6a09-4f48-af57-b3c135a93514 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:11.948534 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-1207b97d-6a09-4f48-af57-b3c135a93514 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:11.949118 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-1207b97d-6a09-4f48-af57-b3c135a93514 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:12.075074 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-0afbf038-f481-45f7-b257-6aa9505919d7 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:12.082084 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-0afbf038-f481-45f7-b257-6aa9505919d7 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] [instance: 8a8be830-80b6-459a-a34e-e19f4b587222] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:47:12.097281 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-0afbf038-f481-45f7-b257-6aa9505919d7 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:12.097734 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-0afbf038-f481-45f7-b257-6aa9505919d7 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:12.098515 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-0afbf038-f481-45f7-b257-6aa9505919d7 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:12.098981 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-0afbf038-f481-45f7-b257-6aa9505919d7 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:12.143336 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-1207b97d-6a09-4f48-af57-b3c135a93514 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "POST /compute/v2.1/servers/fe2c4fd0-315a-4d94-8913-a661cdfa293a/action" status: 202 len: 0 microversion: 2.1 time: 0.214217 Apr 08 02:47:12.144020 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 154/304] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Apr 8 02:47:11 2022] POST /compute/v2.1/servers/fe2c4fd0-315a-4d94-8913-a661cdfa293a/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 02:47:12.169434 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-95894135-76d2-4b17-9152-da78324bf982 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:12.170129 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-95894135-76d2-4b17-9152-da78324bf982 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: fe2c4fd0-315a-4d94-8913-a661cdfa293a] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:47:12.181880 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-95894135-76d2-4b17-9152-da78324bf982 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:12.182330 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-95894135-76d2-4b17-9152-da78324bf982 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:12.183133 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-95894135-76d2-4b17-9152-da78324bf982 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:12.184024 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-95894135-76d2-4b17-9152-da78324bf982 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:12.395916 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-0afbf038-f481-45f7-b257-6aa9505919d7 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94017d79f24adaa76748899bc7c014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fb44db14d6e4c14b82c05f28e8ee9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:47:12.404241 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-0afbf038-f481-45f7-b257-6aa9505919d7 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] 10.222.0.48 "GET /compute/v2.1/servers/8a8be830-80b6-459a-a34e-e19f4b587222" status: 200 len: 1319 microversion: 2.1 time: 0.340562 Apr 08 02:47:12.404886 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 151/305] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:12 2022] GET /compute/v2.1/servers/8a8be830-80b6-459a-a34e-e19f4b587222 => generated 1319 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:47:12.460974 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-95894135-76d2-4b17-9152-da78324bf982 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:47:12.469632 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-95894135-76d2-4b17-9152-da78324bf982 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/fe2c4fd0-315a-4d94-8913-a661cdfa293a" status: 200 len: 1508 microversion: 2.1 time: 0.318059 Apr 08 02:47:12.470158 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 155/306] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:12 2022] GET /compute/v2.1/servers/fe2c4fd0-315a-4d94-8913-a661cdfa293a => generated 1508 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:47:13.427863 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-23fb407c-3395-45cb-b5da-32d48a89a131 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:13.428476 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-23fb407c-3395-45cb-b5da-32d48a89a131 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] [instance: 8a8be830-80b6-459a-a34e-e19f4b587222] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:47:13.435543 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-23fb407c-3395-45cb-b5da-32d48a89a131 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:13.435989 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-23fb407c-3395-45cb-b5da-32d48a89a131 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:13.438615 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-23fb407c-3395-45cb-b5da-32d48a89a131 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:13.438615 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-23fb407c-3395-45cb-b5da-32d48a89a131 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:13.492341 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-712087dc-5cb5-4862-a3bc-2105639999c1 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:13.492951 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-712087dc-5cb5-4862-a3bc-2105639999c1 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: fe2c4fd0-315a-4d94-8913-a661cdfa293a] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:47:13.503339 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-712087dc-5cb5-4862-a3bc-2105639999c1 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:13.503339 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-712087dc-5cb5-4862-a3bc-2105639999c1 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:13.503339 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-712087dc-5cb5-4862-a3bc-2105639999c1 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:13.503339 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-712087dc-5cb5-4862-a3bc-2105639999c1 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:13.702252 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-23fb407c-3395-45cb-b5da-32d48a89a131 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94017d79f24adaa76748899bc7c014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fb44db14d6e4c14b82c05f28e8ee9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:47:13.712897 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-23fb407c-3395-45cb-b5da-32d48a89a131 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] 10.222.0.48 "GET /compute/v2.1/servers/8a8be830-80b6-459a-a34e-e19f4b587222" status: 200 len: 1319 microversion: 2.1 time: 0.295407 Apr 08 02:47:13.713675 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 152/307] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:13 2022] GET /compute/v2.1/servers/8a8be830-80b6-459a-a34e-e19f4b587222 => generated 1319 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:47:13.766659 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-712087dc-5cb5-4862-a3bc-2105639999c1 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:47:13.774517 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-712087dc-5cb5-4862-a3bc-2105639999c1 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/fe2c4fd0-315a-4d94-8913-a661cdfa293a" status: 200 len: 1508 microversion: 2.1 time: 0.292161 Apr 08 02:47:13.775075 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 156/308] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:13 2022] GET /compute/v2.1/servers/fe2c4fd0-315a-4d94-8913-a661cdfa293a => generated 1508 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:47:14.738129 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-93a7104c-cdc1-47e0-82cd-5a50f4afd96e tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:14.738751 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-93a7104c-cdc1-47e0-82cd-5a50f4afd96e tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] [instance: 8a8be830-80b6-459a-a34e-e19f4b587222] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:47:14.745898 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-93a7104c-cdc1-47e0-82cd-5a50f4afd96e tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:14.746337 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-93a7104c-cdc1-47e0-82cd-5a50f4afd96e tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:14.747124 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-93a7104c-cdc1-47e0-82cd-5a50f4afd96e tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:14.747550 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-93a7104c-cdc1-47e0-82cd-5a50f4afd96e tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:14.798044 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-f3942f18-b605-4228-ac7e-a2bd4c441e0f tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:14.798637 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-f3942f18-b605-4228-ac7e-a2bd4c441e0f tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: fe2c4fd0-315a-4d94-8913-a661cdfa293a] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:47:14.805650 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-f3942f18-b605-4228-ac7e-a2bd4c441e0f tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:14.806088 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-f3942f18-b605-4228-ac7e-a2bd4c441e0f tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:14.806889 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-f3942f18-b605-4228-ac7e-a2bd4c441e0f tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:14.807312 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-f3942f18-b605-4228-ac7e-a2bd4c441e0f tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:15.005101 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-93a7104c-cdc1-47e0-82cd-5a50f4afd96e tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94017d79f24adaa76748899bc7c014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fb44db14d6e4c14b82c05f28e8ee9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:47:15.014325 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-93a7104c-cdc1-47e0-82cd-5a50f4afd96e tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] 10.222.0.48 "GET /compute/v2.1/servers/8a8be830-80b6-459a-a34e-e19f4b587222" status: 200 len: 1319 microversion: 2.1 time: 0.284996 Apr 08 02:47:15.018322 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 153/309] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:14 2022] GET /compute/v2.1/servers/8a8be830-80b6-459a-a34e-e19f4b587222 => generated 1319 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:47:15.065364 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-f3942f18-b605-4228-ac7e-a2bd4c441e0f tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:47:15.073291 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-f3942f18-b605-4228-ac7e-a2bd4c441e0f tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/fe2c4fd0-315a-4d94-8913-a661cdfa293a" status: 200 len: 1508 microversion: 2.1 time: 0.284422 Apr 08 02:47:15.073815 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 157/310] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:14 2022] GET /compute/v2.1/servers/fe2c4fd0-315a-4d94-8913-a661cdfa293a => generated 1508 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:47:16.038644 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-73598188-39aa-4055-9063-ad9463673c69 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:16.039254 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-73598188-39aa-4055-9063-ad9463673c69 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] [instance: 8a8be830-80b6-459a-a34e-e19f4b587222] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:47:16.046561 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-73598188-39aa-4055-9063-ad9463673c69 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:16.047032 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-73598188-39aa-4055-9063-ad9463673c69 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:16.047800 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-73598188-39aa-4055-9063-ad9463673c69 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:16.048223 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-73598188-39aa-4055-9063-ad9463673c69 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:16.096729 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-e6404f26-f4f3-4f5b-bb6f-f1fd536669ff tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:16.098012 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-e6404f26-f4f3-4f5b-bb6f-f1fd536669ff tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: fe2c4fd0-315a-4d94-8913-a661cdfa293a] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:47:16.105370 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-e6404f26-f4f3-4f5b-bb6f-f1fd536669ff tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:16.105935 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-e6404f26-f4f3-4f5b-bb6f-f1fd536669ff tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:16.107293 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-e6404f26-f4f3-4f5b-bb6f-f1fd536669ff tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:16.107824 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-e6404f26-f4f3-4f5b-bb6f-f1fd536669ff tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:16.297717 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-73598188-39aa-4055-9063-ad9463673c69 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94017d79f24adaa76748899bc7c014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fb44db14d6e4c14b82c05f28e8ee9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:47:16.305705 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-73598188-39aa-4055-9063-ad9463673c69 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] 10.222.0.48 "GET /compute/v2.1/servers/8a8be830-80b6-459a-a34e-e19f4b587222" status: 200 len: 1319 microversion: 2.1 time: 0.276957 Apr 08 02:47:16.306243 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 154/311] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:16 2022] GET /compute/v2.1/servers/8a8be830-80b6-459a-a34e-e19f4b587222 => generated 1319 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:47:16.356938 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-e6404f26-f4f3-4f5b-bb6f-f1fd536669ff tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:47:16.365042 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-e6404f26-f4f3-4f5b-bb6f-f1fd536669ff tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/fe2c4fd0-315a-4d94-8913-a661cdfa293a" status: 200 len: 1508 microversion: 2.1 time: 0.278279 Apr 08 02:47:16.365567 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 158/312] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:16 2022] GET /compute/v2.1/servers/fe2c4fd0-315a-4d94-8913-a661cdfa293a => generated 1508 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:47:17.328559 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-3641a7c6-1a2a-437a-97ef-356fe97f67f1 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:17.329148 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-3641a7c6-1a2a-437a-97ef-356fe97f67f1 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] [instance: 8a8be830-80b6-459a-a34e-e19f4b587222] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:47:17.336298 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-3641a7c6-1a2a-437a-97ef-356fe97f67f1 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:17.336736 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-3641a7c6-1a2a-437a-97ef-356fe97f67f1 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:17.337497 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-3641a7c6-1a2a-437a-97ef-356fe97f67f1 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:17.337931 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-3641a7c6-1a2a-437a-97ef-356fe97f67f1 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:17.387449 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-bbac067c-2cd2-4ff7-86e5-39f49e161302 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:17.388046 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-bbac067c-2cd2-4ff7-86e5-39f49e161302 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: fe2c4fd0-315a-4d94-8913-a661cdfa293a] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:47:17.395900 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-bbac067c-2cd2-4ff7-86e5-39f49e161302 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:17.396343 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-bbac067c-2cd2-4ff7-86e5-39f49e161302 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:17.397114 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-bbac067c-2cd2-4ff7-86e5-39f49e161302 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:17.397546 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-bbac067c-2cd2-4ff7-86e5-39f49e161302 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:17.597503 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-3641a7c6-1a2a-437a-97ef-356fe97f67f1 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94017d79f24adaa76748899bc7c014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fb44db14d6e4c14b82c05f28e8ee9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:47:17.605738 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-3641a7c6-1a2a-437a-97ef-356fe97f67f1 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] 10.222.0.48 "GET /compute/v2.1/servers/8a8be830-80b6-459a-a34e-e19f4b587222" status: 200 len: 1319 microversion: 2.1 time: 0.286789 Apr 08 02:47:17.606376 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 155/313] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:17 2022] GET /compute/v2.1/servers/8a8be830-80b6-459a-a34e-e19f4b587222 => generated 1319 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:47:17.649399 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-bbac067c-2cd2-4ff7-86e5-39f49e161302 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:47:17.657271 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-bbac067c-2cd2-4ff7-86e5-39f49e161302 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/fe2c4fd0-315a-4d94-8913-a661cdfa293a" status: 200 len: 1508 microversion: 2.1 time: 0.278755 Apr 08 02:47:17.657800 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 159/314] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:17 2022] GET /compute/v2.1/servers/fe2c4fd0-315a-4d94-8913-a661cdfa293a => generated 1508 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:47:18.636831 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-a36c4a86-e1bc-4399-9c5a-603f05a4e8f9 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:18.638287 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-a36c4a86-e1bc-4399-9c5a-603f05a4e8f9 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] [instance: 8a8be830-80b6-459a-a34e-e19f4b587222] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:47:18.649476 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-a36c4a86-e1bc-4399-9c5a-603f05a4e8f9 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:18.650024 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-a36c4a86-e1bc-4399-9c5a-603f05a4e8f9 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:18.651033 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-a36c4a86-e1bc-4399-9c5a-603f05a4e8f9 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:18.651454 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-a36c4a86-e1bc-4399-9c5a-603f05a4e8f9 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:18.695396 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-3dc43641-4d6a-4c53-a758-b49182950703 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:18.696042 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-3dc43641-4d6a-4c53-a758-b49182950703 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: fe2c4fd0-315a-4d94-8913-a661cdfa293a] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:47:18.727816 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-3dc43641-4d6a-4c53-a758-b49182950703 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:18.730512 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-3dc43641-4d6a-4c53-a758-b49182950703 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:18.735624 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-3dc43641-4d6a-4c53-a758-b49182950703 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:18.736074 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-3dc43641-4d6a-4c53-a758-b49182950703 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:18.872744 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-a36c4a86-e1bc-4399-9c5a-603f05a4e8f9 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94017d79f24adaa76748899bc7c014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fb44db14d6e4c14b82c05f28e8ee9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:47:18.882199 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-a36c4a86-e1bc-4399-9c5a-603f05a4e8f9 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] 10.222.0.48 "GET /compute/v2.1/servers/8a8be830-80b6-459a-a34e-e19f4b587222" status: 200 len: 1319 microversion: 2.1 time: 0.262995 Apr 08 02:47:18.914616 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 156/315] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:18 2022] GET /compute/v2.1/servers/8a8be830-80b6-459a-a34e-e19f4b587222 => generated 1319 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:47:19.105995 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-3dc43641-4d6a-4c53-a758-b49182950703 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:47:19.107071 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [req-1f2b1247-8180-447b-8d0a-12f1408de952 req-2d670967-cf0b-4d9e-a7e5-4992f332531b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a8be830-80b6-459a-a34e-e19f4b587222", "name": "network-vif-plugged", "status": "completed", "tag": "81ce21ba-cf6f-417d-ac71-eb07f357b4af"}]} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:47:19.119052 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:47:19.119052 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: warnings.warn(msg) Apr 08 02:47:19.121953 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-3dc43641-4d6a-4c53-a758-b49182950703 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/fe2c4fd0-315a-4d94-8913-a661cdfa293a" status: 200 len: 1508 microversion: 2.1 time: 0.445064 Apr 08 02:47:19.138640 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 160/316] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:18 2022] GET /compute/v2.1/servers/fe2c4fd0-315a-4d94-8913-a661cdfa293a => generated 1508 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:47:19.139044 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-1f2b1247-8180-447b-8d0a-12f1408de952 req-2d670967-cf0b-4d9e-a7e5-4992f332531b service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:19.142431 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-1f2b1247-8180-447b-8d0a-12f1408de952 req-2d670967-cf0b-4d9e-a7e5-4992f332531b service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:19.166461 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.compute.server_external_events [req-1f2b1247-8180-447b-8d0a-12f1408de952 req-2d670967-cf0b-4d9e-a7e5-4992f332531b service nova] Creating event network-vif-plugged:81ce21ba-cf6f-417d-ac71-eb07f357b4af for instance 8a8be830-80b6-459a-a34e-e19f4b587222 on hv-cinder-83705 Apr 08 02:47:19.172157 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [req-1f2b1247-8180-447b-8d0a-12f1408de952 req-2d670967-cf0b-4d9e-a7e5-4992f332531b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083252 Apr 08 02:47:19.173054 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 157/317] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:47:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 02:47:19.905105 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-0425e91a-a26b-4a3b-a869-d161d09c84c9 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:19.906351 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-0425e91a-a26b-4a3b-a869-d161d09c84c9 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] [instance: 8a8be830-80b6-459a-a34e-e19f4b587222] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:47:19.913557 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-0425e91a-a26b-4a3b-a869-d161d09c84c9 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:19.913994 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-0425e91a-a26b-4a3b-a869-d161d09c84c9 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:19.914778 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-0425e91a-a26b-4a3b-a869-d161d09c84c9 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:19.915206 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-0425e91a-a26b-4a3b-a869-d161d09c84c9 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:20.152119 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-969972b9-1374-4720-a70b-b4c676fc373d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:20.152853 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-969972b9-1374-4720-a70b-b4c676fc373d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: fe2c4fd0-315a-4d94-8913-a661cdfa293a] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:47:20.161121 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-969972b9-1374-4720-a70b-b4c676fc373d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:20.161563 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-969972b9-1374-4720-a70b-b4c676fc373d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:20.162339 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-969972b9-1374-4720-a70b-b4c676fc373d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:20.162804 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-969972b9-1374-4720-a70b-b4c676fc373d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:20.363538 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-0425e91a-a26b-4a3b-a869-d161d09c84c9 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94017d79f24adaa76748899bc7c014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fb44db14d6e4c14b82c05f28e8ee9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:47:20.375914 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-0425e91a-a26b-4a3b-a869-d161d09c84c9 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] 10.222.0.48 "GET /compute/v2.1/servers/8a8be830-80b6-459a-a34e-e19f4b587222" status: 200 len: 1319 microversion: 2.1 time: 0.479774 Apr 08 02:47:20.385775 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 161/318] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:19 2022] GET /compute/v2.1/servers/8a8be830-80b6-459a-a34e-e19f4b587222 => generated 1319 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:47:20.475327 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-969972b9-1374-4720-a70b-b4c676fc373d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:47:20.484976 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-969972b9-1374-4720-a70b-b4c676fc373d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/fe2c4fd0-315a-4d94-8913-a661cdfa293a" status: 200 len: 1514 microversion: 2.1 time: 0.341717 Apr 08 02:47:20.486079 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 158/319] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:20 2022] GET /compute/v2.1/servers/fe2c4fd0-315a-4d94-8913-a661cdfa293a => generated 1514 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:47:21.397355 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-4ffd675e-cda3-49d4-be26-f4382c68f10b tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:21.397884 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-4ffd675e-cda3-49d4-be26-f4382c68f10b tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] [instance: 8a8be830-80b6-459a-a34e-e19f4b587222] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:47:21.405024 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-4ffd675e-cda3-49d4-be26-f4382c68f10b tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:21.405465 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-4ffd675e-cda3-49d4-be26-f4382c68f10b tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:21.406309 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-4ffd675e-cda3-49d4-be26-f4382c68f10b tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:21.406772 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-4ffd675e-cda3-49d4-be26-f4382c68f10b tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:21.613315 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-4ffd675e-cda3-49d4-be26-f4382c68f10b tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94017d79f24adaa76748899bc7c014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fb44db14d6e4c14b82c05f28e8ee9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:47:21.621694 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-4ffd675e-cda3-49d4-be26-f4382c68f10b tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] 10.222.0.48 "GET /compute/v2.1/servers/8a8be830-80b6-459a-a34e-e19f4b587222" status: 200 len: 1508 microversion: 2.1 time: 0.233729 Apr 08 02:47:21.622529 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 162/320] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:21 2022] GET /compute/v2.1/servers/8a8be830-80b6-459a-a34e-e19f4b587222 => generated 1508 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:47:23.211654 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-9da2518c-a852-4734-9572-243285b9e2e9 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Action: 'create', calling method: .version_select at 0x7f7d4e229dc0>, body: {"keypair": {"name": "tempest-keypair-361812968"}} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:47:23.254941 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.quota [None req-9da2518c-a852-4734-9572-243285b9e2e9 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Getting quotas for project 2f0c4cd55acc4607852747c5d796609e. Resources: {'key_pairs'} {{(pid=96919) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:47:23.260952 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.quota [None req-9da2518c-a852-4734-9572-243285b9e2e9 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Getting quotas for user 153666ecd9c84936bd1c9ce32373ca27 and project 2f0c4cd55acc4607852747c5d796609e. Resources: {'key_pairs'} {{(pid=96919) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:47:23.343477 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.quota [None req-9da2518c-a852-4734-9572-243285b9e2e9 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Getting quotas for project 2f0c4cd55acc4607852747c5d796609e. Resources: {'key_pairs'} {{(pid=96919) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:47:23.348008 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.quota [None req-9da2518c-a852-4734-9572-243285b9e2e9 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Getting quotas for user 153666ecd9c84936bd1c9ce32373ca27 and project 2f0c4cd55acc4607852747c5d796609e. Resources: {'key_pairs'} {{(pid=96919) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:47:23.360738 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-9da2518c-a852-4734-9572-243285b9e2e9 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.159633 Apr 08 02:47:23.361500 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 159/321] 10.222.0.48 () {60 vars in 1157 bytes} [Fri Apr 8 02:47:23 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:47:25.510536 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-9f689ea3-053a-45f4-aa3a-687a47405b1b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-838608514", "imageRef": "7f8ca061-f382-4052-8d05-69f37e107684", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0f7fec88-7d49-4f5a-9423-d79ffd9641f1"}], "security_groups": [{"name": "tempest-securitygroup--127559271"}], "key_name": "tempest-keypair-361812968", "user_data": "}} {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:47:25.651701 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.network.neutron [None req-9f689ea3-053a-45f4-aa3a-687a47405b1b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] validate_networks() for [('0f7fec88-7d49-4f5a-9423-d79ffd9641f1', None, None, None)] {{(pid=96920) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} Apr 08 02:47:26.328871 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.virt.hardware [None req-9f689ea3-053a-45f4-aa3a-687a47405b1b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Flavor limits 0:0:0 {{(pid=96920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} Apr 08 02:47:26.329428 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.virt.hardware [None req-9f689ea3-053a-45f4-aa3a-687a47405b1b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Image limits 0:0:0 {{(pid=96920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} Apr 08 02:47:26.330010 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.virt.hardware [None req-9f689ea3-053a-45f4-aa3a-687a47405b1b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Flavor pref 0:0:0 {{(pid=96920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} Apr 08 02:47:26.330559 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.virt.hardware [None req-9f689ea3-053a-45f4-aa3a-687a47405b1b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Image pref 0:0:0 {{(pid=96920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} Apr 08 02:47:26.331066 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.virt.hardware [None req-9f689ea3-053a-45f4-aa3a-687a47405b1b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=96920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} Apr 08 02:47:26.339575 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-9f689ea3-053a-45f4-aa3a-687a47405b1b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:26.340237 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-9f689ea3-053a-45f4-aa3a-687a47405b1b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:26.341034 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-9f689ea3-053a-45f4-aa3a-687a47405b1b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:26.341633 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-9f689ea3-053a-45f4-aa3a-687a47405b1b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:26.360976 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.quota [None req-9f689ea3-053a-45f4-aa3a-687a47405b1b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Getting quotas for project 2f0c4cd55acc4607852747c5d796609e. Resources: {'instances', 'cores', 'ram'} {{(pid=96920) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:47:26.366270 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.quota [None req-9f689ea3-053a-45f4-aa3a-687a47405b1b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Getting quotas for user 153666ecd9c84936bd1c9ce32373ca27 and project 2f0c4cd55acc4607852747c5d796609e. Resources: {'instances', 'cores', 'ram'} {{(pid=96920) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:47:26.381817 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-9f689ea3-053a-45f4-aa3a-687a47405b1b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Going to run 1 instances... {{(pid=96920) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} Apr 08 02:47:26.384496 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-9f689ea3-053a-45f4-aa3a-687a47405b1b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 1b72863f-5373-4ef6-b303-1b7955cafa96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7f8ca061-f382-4052-8d05-69f37e107684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=96920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} Apr 08 02:47:26.439203 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-9f689ea3-053a-45f4-aa3a-687a47405b1b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.940233 Apr 08 02:47:26.443601 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 163/322] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Apr 8 02:47:25 2022] POST /compute/v2.1/servers => generated 408 bytes in 945 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 08 02:47:26.456226 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-5d8c4e53-bbd5-4490-8b38-86834b9b648e tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:26.456977 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-5d8c4e53-bbd5-4490-8b38-86834b9b648e tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 1b72863f-5373-4ef6-b303-1b7955cafa96] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:47:26.559733 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-5d8c4e53-bbd5-4490-8b38-86834b9b648e tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:47:26.568209 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-5d8c4e53-bbd5-4490-8b38-86834b9b648e tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96" status: 200 len: 1244 microversion: 2.1 time: 0.122381 Apr 08 02:47:26.568968 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 160/323] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:26 2022] GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96 => generated 1244 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:47:27.590735 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-24822ec7-fbb7-4c6b-917b-bcf35be30619 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:27.591278 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-24822ec7-fbb7-4c6b-917b-bcf35be30619 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 1b72863f-5373-4ef6-b303-1b7955cafa96] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:47:27.599164 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-24822ec7-fbb7-4c6b-917b-bcf35be30619 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:27.599621 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-24822ec7-fbb7-4c6b-917b-bcf35be30619 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:27.600387 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-24822ec7-fbb7-4c6b-917b-bcf35be30619 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:27.600820 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-24822ec7-fbb7-4c6b-917b-bcf35be30619 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:27.732158 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-24822ec7-fbb7-4c6b-917b-bcf35be30619 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:47:27.742820 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-24822ec7-fbb7-4c6b-917b-bcf35be30619 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96" status: 200 len: 1296 microversion: 2.1 time: 0.161026 Apr 08 02:47:27.743694 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 164/324] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:27 2022] GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96 => generated 1296 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:47:28.767276 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-1cf5cb22-ecb1-4e05-8f81-377d59b105b8 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:28.767972 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-1cf5cb22-ecb1-4e05-8f81-377d59b105b8 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 1b72863f-5373-4ef6-b303-1b7955cafa96] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:47:28.776523 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-1cf5cb22-ecb1-4e05-8f81-377d59b105b8 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:28.776962 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-1cf5cb22-ecb1-4e05-8f81-377d59b105b8 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:28.777736 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-1cf5cb22-ecb1-4e05-8f81-377d59b105b8 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:28.778167 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-1cf5cb22-ecb1-4e05-8f81-377d59b105b8 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:29.062086 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-1cf5cb22-ecb1-4e05-8f81-377d59b105b8 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:47:29.070755 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-1cf5cb22-ecb1-4e05-8f81-377d59b105b8 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96" status: 200 len: 1369 microversion: 2.1 time: 0.313598 Apr 08 02:47:29.081400 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 161/325] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:28 2022] GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96 => generated 1369 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:47:30.045597 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [req-122e8185-5f3d-4c81-88bd-b0fb5f9179a8 req-601b30c6-174d-435d-a178-9d9856cf8d69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b72863f-5373-4ef6-b303-1b7955cafa96", "tag": "925ad71f-f0c4-4cad-b48b-9505cac52cd3"}]} {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:47:30.058940 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:47:30.058940 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: warnings.warn(msg) Apr 08 02:47:30.068902 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-122e8185-5f3d-4c81-88bd-b0fb5f9179a8 req-601b30c6-174d-435d-a178-9d9856cf8d69 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:30.069550 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-122e8185-5f3d-4c81-88bd-b0fb5f9179a8 req-601b30c6-174d-435d-a178-9d9856cf8d69 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:30.094423 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.compute.server_external_events [req-122e8185-5f3d-4c81-88bd-b0fb5f9179a8 req-601b30c6-174d-435d-a178-9d9856cf8d69 service nova] Creating event network-changed:925ad71f-f0c4-4cad-b48b-9505cac52cd3 for instance 1b72863f-5373-4ef6-b303-1b7955cafa96 on hv-cinder-83705 Apr 08 02:47:30.099916 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [req-122e8185-5f3d-4c81-88bd-b0fb5f9179a8 req-601b30c6-174d-435d-a178-9d9856cf8d69 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076630 Apr 08 02:47:30.100848 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 165/326] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:47:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:47:30.101395 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-c00a9308-bfb4-439e-a44b-bfe19b42e18f tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:30.102589 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-c00a9308-bfb4-439e-a44b-bfe19b42e18f tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 1b72863f-5373-4ef6-b303-1b7955cafa96] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:47:30.111636 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-c00a9308-bfb4-439e-a44b-bfe19b42e18f tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:30.112461 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-c00a9308-bfb4-439e-a44b-bfe19b42e18f tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:30.114041 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-c00a9308-bfb4-439e-a44b-bfe19b42e18f tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:30.114699 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-c00a9308-bfb4-439e-a44b-bfe19b42e18f tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:30.395017 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-c00a9308-bfb4-439e-a44b-bfe19b42e18f tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:47:30.411405 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-c00a9308-bfb4-439e-a44b-bfe19b42e18f tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96" status: 200 len: 1369 microversion: 2.1 time: 0.317309 Apr 08 02:47:30.411405 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 162/327] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:30 2022] GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96 => generated 1369 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:47:31.433174 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-0dc2005f-006a-4f55-9fe0-f00274bb5313 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:31.435278 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-0dc2005f-006a-4f55-9fe0-f00274bb5313 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 1b72863f-5373-4ef6-b303-1b7955cafa96] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:47:31.446189 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-0dc2005f-006a-4f55-9fe0-f00274bb5313 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:31.447172 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-0dc2005f-006a-4f55-9fe0-f00274bb5313 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:31.448692 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-0dc2005f-006a-4f55-9fe0-f00274bb5313 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:31.449275 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-0dc2005f-006a-4f55-9fe0-f00274bb5313 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:31.788637 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-0dc2005f-006a-4f55-9fe0-f00274bb5313 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:47:31.798496 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-0dc2005f-006a-4f55-9fe0-f00274bb5313 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96" status: 200 len: 1369 microversion: 2.1 time: 0.380573 Apr 08 02:47:31.808124 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 166/328] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:31 2022] GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96 => generated 1369 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:47:32.821317 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-3c934c17-1c5d-4ca1-9010-c3695d8b72ea tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:32.821914 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-3c934c17-1c5d-4ca1-9010-c3695d8b72ea tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 1b72863f-5373-4ef6-b303-1b7955cafa96] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:47:32.830833 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-3c934c17-1c5d-4ca1-9010-c3695d8b72ea tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:32.831527 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-3c934c17-1c5d-4ca1-9010-c3695d8b72ea tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:32.832477 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-3c934c17-1c5d-4ca1-9010-c3695d8b72ea tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:32.832974 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-3c934c17-1c5d-4ca1-9010-c3695d8b72ea tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:33.083430 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-3c934c17-1c5d-4ca1-9010-c3695d8b72ea tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:47:33.095522 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-3c934c17-1c5d-4ca1-9010-c3695d8b72ea tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96" status: 200 len: 1369 microversion: 2.1 time: 0.283451 Apr 08 02:47:33.096057 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 163/329] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:32 2022] GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96 => generated 1369 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:47:34.118074 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-3bb82165-64f7-459a-91c6-a055ab886cbd tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:34.118636 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-3bb82165-64f7-459a-91c6-a055ab886cbd tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 1b72863f-5373-4ef6-b303-1b7955cafa96] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:47:34.126946 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-3bb82165-64f7-459a-91c6-a055ab886cbd tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:34.133442 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-3bb82165-64f7-459a-91c6-a055ab886cbd tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:34.134367 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-3bb82165-64f7-459a-91c6-a055ab886cbd tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:34.135417 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-3bb82165-64f7-459a-91c6-a055ab886cbd tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:34.473717 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-3bb82165-64f7-459a-91c6-a055ab886cbd tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:47:34.485805 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-3bb82165-64f7-459a-91c6-a055ab886cbd tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96" status: 200 len: 1369 microversion: 2.1 time: 0.377187 Apr 08 02:47:34.486364 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 167/330] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:34 2022] GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96 => generated 1369 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:47:35.511884 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-51cf10ac-34cb-4d36-a032-c8ff216649c4 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:35.512510 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-51cf10ac-34cb-4d36-a032-c8ff216649c4 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 1b72863f-5373-4ef6-b303-1b7955cafa96] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:47:35.520574 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-51cf10ac-34cb-4d36-a032-c8ff216649c4 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:35.520918 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-51cf10ac-34cb-4d36-a032-c8ff216649c4 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:35.521758 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-51cf10ac-34cb-4d36-a032-c8ff216649c4 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:35.522095 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-51cf10ac-34cb-4d36-a032-c8ff216649c4 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:35.904167 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-51cf10ac-34cb-4d36-a032-c8ff216649c4 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:47:35.912856 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-51cf10ac-34cb-4d36-a032-c8ff216649c4 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96" status: 200 len: 1369 microversion: 2.1 time: 0.411932 Apr 08 02:47:35.913377 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 164/331] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:35 2022] GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96 => generated 1369 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:47:36.936532 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-309636d1-eb4c-4d8b-a0d9-77c14d324060 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:36.937166 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-309636d1-eb4c-4d8b-a0d9-77c14d324060 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 1b72863f-5373-4ef6-b303-1b7955cafa96] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:47:36.944378 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-309636d1-eb4c-4d8b-a0d9-77c14d324060 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:36.944814 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-309636d1-eb4c-4d8b-a0d9-77c14d324060 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:36.945574 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-309636d1-eb4c-4d8b-a0d9-77c14d324060 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:36.945998 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-309636d1-eb4c-4d8b-a0d9-77c14d324060 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:37.165671 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-309636d1-eb4c-4d8b-a0d9-77c14d324060 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:47:37.174068 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-309636d1-eb4c-4d8b-a0d9-77c14d324060 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96" status: 200 len: 1369 microversion: 2.1 time: 0.247334 Apr 08 02:47:37.174595 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 168/332] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:36 2022] GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96 => generated 1369 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:47:38.196700 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-29d8858e-db96-4bf6-b74b-e1613afe7868 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:38.197914 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-29d8858e-db96-4bf6-b74b-e1613afe7868 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 1b72863f-5373-4ef6-b303-1b7955cafa96] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:47:38.206884 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-29d8858e-db96-4bf6-b74b-e1613afe7868 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:38.207319 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-29d8858e-db96-4bf6-b74b-e1613afe7868 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:38.208098 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-29d8858e-db96-4bf6-b74b-e1613afe7868 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:38.208523 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-29d8858e-db96-4bf6-b74b-e1613afe7868 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:38.426283 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-29d8858e-db96-4bf6-b74b-e1613afe7868 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:47:38.435325 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-29d8858e-db96-4bf6-b74b-e1613afe7868 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96" status: 200 len: 1369 microversion: 2.1 time: 0.248422 Apr 08 02:47:38.436513 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 165/333] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:38 2022] GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96 => generated 1369 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:47:39.459421 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-f78253a5-e9f6-4689-bc86-0ce469af0b05 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:39.460018 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-f78253a5-e9f6-4689-bc86-0ce469af0b05 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 1b72863f-5373-4ef6-b303-1b7955cafa96] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:47:39.468482 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-f78253a5-e9f6-4689-bc86-0ce469af0b05 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:39.468864 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-f78253a5-e9f6-4689-bc86-0ce469af0b05 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:39.469645 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-f78253a5-e9f6-4689-bc86-0ce469af0b05 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:39.470151 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-f78253a5-e9f6-4689-bc86-0ce469af0b05 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:39.682880 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-f78253a5-e9f6-4689-bc86-0ce469af0b05 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:47:39.691839 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-f78253a5-e9f6-4689-bc86-0ce469af0b05 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96" status: 200 len: 1369 microversion: 2.1 time: 0.242542 Apr 08 02:47:39.692389 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 169/334] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:39 2022] GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96 => generated 1369 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:47:40.716543 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-e2f8561f-0b76-458a-9bce-469f1bee3408 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:40.717310 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-e2f8561f-0b76-458a-9bce-469f1bee3408 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 1b72863f-5373-4ef6-b303-1b7955cafa96] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:47:40.724465 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-e2f8561f-0b76-458a-9bce-469f1bee3408 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:40.724938 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-e2f8561f-0b76-458a-9bce-469f1bee3408 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:40.725696 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-e2f8561f-0b76-458a-9bce-469f1bee3408 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:40.726121 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-e2f8561f-0b76-458a-9bce-469f1bee3408 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:40.965077 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-e2f8561f-0b76-458a-9bce-469f1bee3408 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:47:40.974972 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-e2f8561f-0b76-458a-9bce-469f1bee3408 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96" status: 200 len: 1369 microversion: 2.1 time: 0.267159 Apr 08 02:47:40.982331 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 166/335] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:40 2022] GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96 => generated 1369 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:47:41.056812 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [req-7029b7e9-78e8-40c0-9772-baee20f0d6e4 req-6d195e20-ddaa-4d51-a5d9-07ac313a592b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b72863f-5373-4ef6-b303-1b7955cafa96", "name": "network-vif-plugged", "status": "completed", "tag": "925ad71f-f0c4-4cad-b48b-9505cac52cd3"}]} {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:47:41.064036 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:47:41.064036 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: warnings.warn(msg) Apr 08 02:47:41.072884 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-7029b7e9-78e8-40c0-9772-baee20f0d6e4 req-6d195e20-ddaa-4d51-a5d9-07ac313a592b service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:41.073621 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-7029b7e9-78e8-40c0-9772-baee20f0d6e4 req-6d195e20-ddaa-4d51-a5d9-07ac313a592b service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:41.091118 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.compute.server_external_events [req-7029b7e9-78e8-40c0-9772-baee20f0d6e4 req-6d195e20-ddaa-4d51-a5d9-07ac313a592b service nova] Creating event network-vif-plugged:925ad71f-f0c4-4cad-b48b-9505cac52cd3 for instance 1b72863f-5373-4ef6-b303-1b7955cafa96 on hv-cinder-83705 Apr 08 02:47:41.096997 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [req-7029b7e9-78e8-40c0-9772-baee20f0d6e4 req-6d195e20-ddaa-4d51-a5d9-07ac313a592b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050035 Apr 08 02:47:41.097620 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 170/336] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:47:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:47:41.998894 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-537e0c2f-3550-4836-8aed-c28688ef5756 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:41.999500 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-537e0c2f-3550-4836-8aed-c28688ef5756 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 1b72863f-5373-4ef6-b303-1b7955cafa96] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:47:42.007046 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-537e0c2f-3550-4836-8aed-c28688ef5756 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:42.007498 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-537e0c2f-3550-4836-8aed-c28688ef5756 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:42.008612 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-537e0c2f-3550-4836-8aed-c28688ef5756 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:42.009174 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-537e0c2f-3550-4836-8aed-c28688ef5756 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:42.218407 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-537e0c2f-3550-4836-8aed-c28688ef5756 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:47:42.226642 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-537e0c2f-3550-4836-8aed-c28688ef5756 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96" status: 200 len: 1369 microversion: 2.1 time: 0.237582 Apr 08 02:47:42.227261 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 167/337] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:41 2022] GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96 => generated 1369 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:47:43.249226 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-db819bb2-e022-4e3a-96bd-5ed42aa387a7 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:43.249906 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-db819bb2-e022-4e3a-96bd-5ed42aa387a7 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 1b72863f-5373-4ef6-b303-1b7955cafa96] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:47:43.257236 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-db819bb2-e022-4e3a-96bd-5ed42aa387a7 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:43.257673 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-db819bb2-e022-4e3a-96bd-5ed42aa387a7 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:43.258420 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-db819bb2-e022-4e3a-96bd-5ed42aa387a7 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:43.258889 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-db819bb2-e022-4e3a-96bd-5ed42aa387a7 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:43.477594 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-db819bb2-e022-4e3a-96bd-5ed42aa387a7 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:47:43.486105 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-db819bb2-e022-4e3a-96bd-5ed42aa387a7 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96" status: 200 len: 1369 microversion: 2.1 time: 0.246927 Apr 08 02:47:43.486639 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 171/338] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:43 2022] GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96 => generated 1369 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:47:44.508197 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-8d15a1f9-5671-40c3-b996-e9aeb99a5094 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:44.508786 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-8d15a1f9-5671-40c3-b996-e9aeb99a5094 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 1b72863f-5373-4ef6-b303-1b7955cafa96] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:47:44.516903 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-8d15a1f9-5671-40c3-b996-e9aeb99a5094 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:44.517282 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-8d15a1f9-5671-40c3-b996-e9aeb99a5094 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:44.518040 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-8d15a1f9-5671-40c3-b996-e9aeb99a5094 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:44.518465 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-8d15a1f9-5671-40c3-b996-e9aeb99a5094 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:44.720870 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-8d15a1f9-5671-40c3-b996-e9aeb99a5094 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:47:44.728882 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-8d15a1f9-5671-40c3-b996-e9aeb99a5094 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96" status: 200 len: 1562 microversion: 2.1 time: 0.229550 Apr 08 02:47:44.729402 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 168/339] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:47:44 2022] GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96 => generated 1562 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:47:44.751499 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-d305fa33-0dad-47ce-9fc6-bc6de9902783 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:47:44.751979 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-d305fa33-0dad-47ce-9fc6-bc6de9902783 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 1b72863f-5373-4ef6-b303-1b7955cafa96] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:47:44.759109 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-d305fa33-0dad-47ce-9fc6-bc6de9902783 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:44.759546 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-d305fa33-0dad-47ce-9fc6-bc6de9902783 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:44.760297 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-d305fa33-0dad-47ce-9fc6-bc6de9902783 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:44.760721 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-d305fa33-0dad-47ce-9fc6-bc6de9902783 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:44.906309 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-d305fa33-0dad-47ce-9fc6-bc6de9902783 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.164719 Apr 08 02:47:44.906938 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 172/340] 10.222.0.48 () {58 vars in 1274 bytes} [Fri Apr 8 02:47:44 2022] GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96/os-interface => generated 284 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:47:46.545566 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [req-6b1edef0-a5af-41d5-836b-5acba5b75a91 req-7ff8109f-10ff-4b08-ab7e-19e85c724412 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b72863f-5373-4ef6-b303-1b7955cafa96", "tag": "925ad71f-f0c4-4cad-b48b-9505cac52cd3"}]} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:47:46.552212 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:47:46.552212 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: warnings.warn(msg) Apr 08 02:47:46.560960 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-6b1edef0-a5af-41d5-836b-5acba5b75a91 req-7ff8109f-10ff-4b08-ab7e-19e85c724412 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:47:46.561772 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-6b1edef0-a5af-41d5-836b-5acba5b75a91 req-7ff8109f-10ff-4b08-ab7e-19e85c724412 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:47:46.578607 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.compute.server_external_events [req-6b1edef0-a5af-41d5-836b-5acba5b75a91 req-7ff8109f-10ff-4b08-ab7e-19e85c724412 service nova] Creating event network-changed:925ad71f-f0c4-4cad-b48b-9505cac52cd3 for instance 1b72863f-5373-4ef6-b303-1b7955cafa96 on hv-cinder-83705 Apr 08 02:47:46.585436 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [req-6b1edef0-a5af-41d5-836b-5acba5b75a91 req-7ff8109f-10ff-4b08-ab7e-19e85c724412 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057900 Apr 08 02:47:46.588564 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 169/341] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:47:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:48:02.713829 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-aab677eb-038c-4fd7-bde2-6eee3060f3cc tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fa68a41e-1029-455a-83df-1b0013baaf0f", "device": "/dev/sdb"}} {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:48:02.715396 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-aab677eb-038c-4fd7-bde2-6eee3060f3cc tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] [instance: 8a8be830-80b6-459a-a34e-e19f4b587222] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:48:02.723219 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-aab677eb-038c-4fd7-bde2-6eee3060f3cc tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:02.723653 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-aab677eb-038c-4fd7-bde2-6eee3060f3cc tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:02.724399 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-aab677eb-038c-4fd7-bde2-6eee3060f3cc tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:02.724821 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-aab677eb-038c-4fd7-bde2-6eee3060f3cc tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:03.111518 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-aab677eb-038c-4fd7-bde2-6eee3060f3cc tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] 10.222.0.48 "POST /compute/v2.1/servers/8a8be830-80b6-459a-a34e-e19f4b587222/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.406692 Apr 08 02:48:03.112282 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 173/342] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Apr 8 02:48:02 2022] POST /compute/v2.1/servers/8a8be830-80b6-459a-a34e-e19f4b587222/os-volume_attachments => generated 194 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:48:42.579114 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f3579bfd-0989-4d7e-8307-4b43384799a0] AMQP server on 10.222.0.48:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 08 02:48:42.588341 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-8cc82f91-e6c4-462f-9fb5-453622499fea tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:48:42.588960 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-8cc82f91-e6c4-462f-9fb5-453622499fea tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] [instance: 8a8be830-80b6-459a-a34e-e19f4b587222] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:48:42.597761 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-8cc82f91-e6c4-462f-9fb5-453622499fea tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:42.598203 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-8cc82f91-e6c4-462f-9fb5-453622499fea tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:42.598996 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-8cc82f91-e6c4-462f-9fb5-453622499fea tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:42.599426 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-8cc82f91-e6c4-462f-9fb5-453622499fea tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:42.840352 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-8cc82f91-e6c4-462f-9fb5-453622499fea tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8a8be830-80b6-459a-a34e-e19f4b587222/os-volume_attachments/fa68a41e-1029-455a-83df-1b0013baaf0f" status: 202 len: 0 microversion: 2.1 time: 0.262479 Apr 08 02:48:42.840912 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 170/343] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Apr 8 02:48:42 2022] DELETE /compute/v2.1/servers/8a8be830-80b6-459a-a34e-e19f4b587222/os-volume_attachments/fa68a41e-1029-455a-83df-1b0013baaf0f => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 02:48:49.458344 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 08 02:48:49.458861 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: Fri Apr 8 02:48:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8a8be830-80b6-459a-a34e-e19f4b587222 (ip 10.222.0.48) !!! Apr 08 02:48:49.477989 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-f61ba979-dba3-404a-bd3d-8fa840002dc0 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:48:49.478558 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-f61ba979-dba3-404a-bd3d-8fa840002dc0 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] [instance: 8a8be830-80b6-459a-a34e-e19f4b587222] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:48:49.488429 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-f61ba979-dba3-404a-bd3d-8fa840002dc0 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:49.488869 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-f61ba979-dba3-404a-bd3d-8fa840002dc0 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:49.489626 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-f61ba979-dba3-404a-bd3d-8fa840002dc0 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:49.490054 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-f61ba979-dba3-404a-bd3d-8fa840002dc0 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:49.554272 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-f61ba979-dba3-404a-bd3d-8fa840002dc0 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] [instance: 8a8be830-80b6-459a-a34e-e19f4b587222] Going to try to terminate instance {{(pid=96920) delete /opt/stack/nova/nova/compute/api.py:2559}} Apr 08 02:48:49.664018 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-f61ba979-dba3-404a-bd3d-8fa840002dc0 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8a8be830-80b6-459a-a34e-e19f4b587222" status: 204 len: 0 microversion: 2.1 time: 0.206851 Apr 08 02:48:49.664629 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 174/344] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Apr 8 02:48:49 2022] DELETE /compute/v2.1/servers/8a8be830-80b6-459a-a34e-e19f4b587222 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 08 02:48:49.690809 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-d77b330e-6a0d-4175-966a-1018c1676cb9 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:48:49.691497 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-d77b330e-6a0d-4175-966a-1018c1676cb9 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] [instance: 8a8be830-80b6-459a-a34e-e19f4b587222] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:48:49.700418 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-d77b330e-6a0d-4175-966a-1018c1676cb9 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:49.700858 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-d77b330e-6a0d-4175-966a-1018c1676cb9 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:49.701618 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-d77b330e-6a0d-4175-966a-1018c1676cb9 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:49.702061 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-d77b330e-6a0d-4175-966a-1018c1676cb9 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:49.726499 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO oslo.messaging._drivers.impl_rabbit [-] [f3579bfd-0989-4d7e-8307-4b43384799a0] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 48770. Apr 08 02:48:49.905087 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-d77b330e-6a0d-4175-966a-1018c1676cb9 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94017d79f24adaa76748899bc7c014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fb44db14d6e4c14b82c05f28e8ee9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:48:49.913164 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-d77b330e-6a0d-4175-966a-1018c1676cb9 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] 10.222.0.48 "GET /compute/v2.1/servers/8a8be830-80b6-459a-a34e-e19f4b587222" status: 200 len: 1514 microversion: 2.1 time: 0.243874 Apr 08 02:48:49.913688 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 171/345] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:48:49 2022] GET /compute/v2.1/servers/8a8be830-80b6-459a-a34e-e19f4b587222 => generated 1514 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:48:50.935858 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-389628bb-f311-488b-ba28-c3db03ae009a tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:48:50.936536 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-389628bb-f311-488b-ba28-c3db03ae009a tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] [instance: 8a8be830-80b6-459a-a34e-e19f4b587222] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:48:50.947483 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-389628bb-f311-488b-ba28-c3db03ae009a tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:50.947921 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-389628bb-f311-488b-ba28-c3db03ae009a tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:50.948674 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-389628bb-f311-488b-ba28-c3db03ae009a tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:50.949096 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-389628bb-f311-488b-ba28-c3db03ae009a tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:51.150170 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-389628bb-f311-488b-ba28-c3db03ae009a tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94017d79f24adaa76748899bc7c014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fb44db14d6e4c14b82c05f28e8ee9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:48:51.158929 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-389628bb-f311-488b-ba28-c3db03ae009a tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] 10.222.0.48 "GET /compute/v2.1/servers/8a8be830-80b6-459a-a34e-e19f4b587222" status: 200 len: 1514 microversion: 2.1 time: 0.232394 Apr 08 02:48:51.159456 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 175/346] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:48:50 2022] GET /compute/v2.1/servers/8a8be830-80b6-459a-a34e-e19f4b587222 => generated 1514 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:48:52.187066 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-d86a2e32-05b4-4658-a79c-85a12ef1509f tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:48:52.189061 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-d86a2e32-05b4-4658-a79c-85a12ef1509f tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] [instance: 8a8be830-80b6-459a-a34e-e19f4b587222] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:48:52.199048 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-d86a2e32-05b4-4658-a79c-85a12ef1509f tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:52.200000 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-d86a2e32-05b4-4658-a79c-85a12ef1509f tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:52.200945 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-d86a2e32-05b4-4658-a79c-85a12ef1509f tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:52.201539 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-d86a2e32-05b4-4658-a79c-85a12ef1509f tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:52.435428 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-d86a2e32-05b4-4658-a79c-85a12ef1509f tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94017d79f24adaa76748899bc7c014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fb44db14d6e4c14b82c05f28e8ee9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:48:52.444557 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-d86a2e32-05b4-4658-a79c-85a12ef1509f tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] 10.222.0.48 "GET /compute/v2.1/servers/8a8be830-80b6-459a-a34e-e19f4b587222" status: 200 len: 1514 microversion: 2.1 time: 0.272010 Apr 08 02:48:52.445078 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 172/347] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:48:52 2022] GET /compute/v2.1/servers/8a8be830-80b6-459a-a34e-e19f4b587222 => generated 1514 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:48:52.647674 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [req-c5459aec-27b3-40c0-9bff-668cc56dc585 req-83f281ad-6738-4503-b57c-3f55db3ce0a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a8be830-80b6-459a-a34e-e19f4b587222", "name": "network-vif-deleted", "tag": "81ce21ba-cf6f-417d-ac71-eb07f357b4af"}]} {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:48:52.654541 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:48:52.654541 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: warnings.warn(msg) Apr 08 02:48:52.664010 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-c5459aec-27b3-40c0-9bff-668cc56dc585 req-83f281ad-6738-4503-b57c-3f55db3ce0a7 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:52.664444 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-c5459aec-27b3-40c0-9bff-668cc56dc585 req-83f281ad-6738-4503-b57c-3f55db3ce0a7 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:52.679549 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.compute.server_external_events [req-c5459aec-27b3-40c0-9bff-668cc56dc585 req-83f281ad-6738-4503-b57c-3f55db3ce0a7 service nova] Creating event network-vif-deleted:81ce21ba-cf6f-417d-ac71-eb07f357b4af for instance 8a8be830-80b6-459a-a34e-e19f4b587222 on hv-cinder-83705 Apr 08 02:48:52.684104 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [req-c5459aec-27b3-40c0-9bff-668cc56dc585 req-83f281ad-6738-4503-b57c-3f55db3ce0a7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045702 Apr 08 02:48:52.684677 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 176/348] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:48:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:48:53.466208 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-ecefb507-f051-4e4d-bfde-f228793b1563 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:48:53.466838 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-ecefb507-f051-4e4d-bfde-f228793b1563 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] [instance: 8a8be830-80b6-459a-a34e-e19f4b587222] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:48:53.473901 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ecefb507-f051-4e4d-bfde-f228793b1563 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:53.474339 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ecefb507-f051-4e4d-bfde-f228793b1563 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:53.475120 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ecefb507-f051-4e4d-bfde-f228793b1563 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:53.475549 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ecefb507-f051-4e4d-bfde-f228793b1563 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:53.548661 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ecefb507-f051-4e4d-bfde-f228793b1563 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:53.549054 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ecefb507-f051-4e4d-bfde-f228793b1563 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:53.549490 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.objects.instance [None req-ecefb507-f051-4e4d-bfde-f228793b1563 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lazy-loading 'fault' on Instance uuid 8a8be830-80b6-459a-a34e-e19f4b587222 {{(pid=96919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 08 02:48:53.608302 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-ecefb507-f051-4e4d-bfde-f228793b1563 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94017d79f24adaa76748899bc7c014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fb44db14d6e4c14b82c05f28e8ee9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:48:53.616176 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-ecefb507-f051-4e4d-bfde-f228793b1563 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] 10.222.0.48 "GET /compute/v2.1/servers/8a8be830-80b6-459a-a34e-e19f4b587222" status: 200 len: 1309 microversion: 2.1 time: 0.158740 Apr 08 02:48:53.616701 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 173/349] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:48:53 2022] GET /compute/v2.1/servers/8a8be830-80b6-459a-a34e-e19f4b587222 => generated 1309 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:48:54.640291 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-3b23de57-fd10-4eee-82b3-209fb5d33a8c tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:48:54.640980 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-3b23de57-fd10-4eee-82b3-209fb5d33a8c tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] [instance: 8a8be830-80b6-459a-a34e-e19f4b587222] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:48:54.648376 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-3b23de57-fd10-4eee-82b3-209fb5d33a8c tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:54.648816 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-3b23de57-fd10-4eee-82b3-209fb5d33a8c tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:54.649573 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-3b23de57-fd10-4eee-82b3-209fb5d33a8c tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:54.649997 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-3b23de57-fd10-4eee-82b3-209fb5d33a8c tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:54.721587 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-3b23de57-fd10-4eee-82b3-209fb5d33a8c tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:54.722023 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-3b23de57-fd10-4eee-82b3-209fb5d33a8c tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:54.722461 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.objects.instance [None req-3b23de57-fd10-4eee-82b3-209fb5d33a8c tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lazy-loading 'fault' on Instance uuid 8a8be830-80b6-459a-a34e-e19f4b587222 {{(pid=96920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 08 02:48:54.784244 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-3b23de57-fd10-4eee-82b3-209fb5d33a8c tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94017d79f24adaa76748899bc7c014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fb44db14d6e4c14b82c05f28e8ee9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:48:54.792154 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-3b23de57-fd10-4eee-82b3-209fb5d33a8c tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] 10.222.0.48 "GET /compute/v2.1/servers/8a8be830-80b6-459a-a34e-e19f4b587222" status: 200 len: 1309 microversion: 2.1 time: 0.162470 Apr 08 02:48:54.792683 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 177/350] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:48:54 2022] GET /compute/v2.1/servers/8a8be830-80b6-459a-a34e-e19f4b587222 => generated 1309 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:48:55.815138 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-1040fbce-e7e7-4085-b44e-99b4f053b99a tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:48:55.815738 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-1040fbce-e7e7-4085-b44e-99b4f053b99a tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] [instance: 8a8be830-80b6-459a-a34e-e19f4b587222] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:48:55.823457 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-1040fbce-e7e7-4085-b44e-99b4f053b99a tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:55.823892 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-1040fbce-e7e7-4085-b44e-99b4f053b99a tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:55.825185 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-1040fbce-e7e7-4085-b44e-99b4f053b99a tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:55.825698 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-1040fbce-e7e7-4085-b44e-99b4f053b99a tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:55.895329 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-1040fbce-e7e7-4085-b44e-99b4f053b99a tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:55.895769 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-1040fbce-e7e7-4085-b44e-99b4f053b99a tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:55.896209 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.objects.instance [None req-1040fbce-e7e7-4085-b44e-99b4f053b99a tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lazy-loading 'fault' on Instance uuid 8a8be830-80b6-459a-a34e-e19f4b587222 {{(pid=96919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 08 02:48:55.954312 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-1040fbce-e7e7-4085-b44e-99b4f053b99a tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94017d79f24adaa76748899bc7c014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fb44db14d6e4c14b82c05f28e8ee9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:48:55.962268 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-1040fbce-e7e7-4085-b44e-99b4f053b99a tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] 10.222.0.48 "GET /compute/v2.1/servers/8a8be830-80b6-459a-a34e-e19f4b587222" status: 200 len: 1309 microversion: 2.1 time: 0.156478 Apr 08 02:48:55.962814 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 174/351] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:48:55 2022] GET /compute/v2.1/servers/8a8be830-80b6-459a-a34e-e19f4b587222 => generated 1309 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:48:56.984738 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-a80765d9-4990-4b24-b93a-405fc4e8a2bb tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:48:56.985329 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-a80765d9-4990-4b24-b93a-405fc4e8a2bb tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] [instance: 8a8be830-80b6-459a-a34e-e19f4b587222] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:48:56.993562 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-a80765d9-4990-4b24-b93a-405fc4e8a2bb tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:56.994000 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-a80765d9-4990-4b24-b93a-405fc4e8a2bb tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:56.994777 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-a80765d9-4990-4b24-b93a-405fc4e8a2bb tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:56.995197 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-a80765d9-4990-4b24-b93a-405fc4e8a2bb tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:57.051357 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.wsgi [None req-a80765d9-4990-4b24-b93a-405fc4e8a2bb tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] HTTP exception thrown: Instance 8a8be830-80b6-459a-a34e-e19f4b587222 could not be found. Apr 08 02:48:57.051938 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-a80765d9-4990-4b24-b93a-405fc4e8a2bb tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Returning 404 to user: Instance 8a8be830-80b6-459a-a34e-e19f4b587222 could not be found. {{(pid=96920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Apr 08 02:48:57.052743 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-a80765d9-4990-4b24-b93a-405fc4e8a2bb tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] 10.222.0.48 "GET /compute/v2.1/servers/8a8be830-80b6-459a-a34e-e19f4b587222" status: 404 len: 111 microversion: 2.1 time: 0.076994 Apr 08 02:48:57.053276 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 178/352] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:48:56 2022] GET /compute/v2.1/servers/8a8be830-80b6-459a-a34e-e19f4b587222 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 02:48:59.559233 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-db4df314-abdf-4271-b1fc-57fc961ad3dd tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:48:59.559767 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-db4df314-abdf-4271-b1fc-57fc961ad3dd tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:48:59.566785 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-db4df314-abdf-4271-b1fc-57fc961ad3dd tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:59.567227 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-db4df314-abdf-4271-b1fc-57fc961ad3dd tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:59.567992 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-db4df314-abdf-4271-b1fc-57fc961ad3dd tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:48:59.568421 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-db4df314-abdf-4271-b1fc-57fc961ad3dd tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:48:59.629201 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-db4df314-abdf-4271-b1fc-57fc961ad3dd tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf/ips" status: 200 len: 153 microversion: 2.20 time: 0.078929 Apr 08 02:48:59.629742 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 175/353] 10.222.0.48 () {60 vars in 1288 bytes} [Fri Apr 8 02:48:59 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf/ips => generated 153 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 02:49:01.887329 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-41bf6cee-fd27-465c-aaa1-5e7978dbd88b tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:01.887914 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-41bf6cee-fd27-465c-aaa1-5e7978dbd88b tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 09e6abc6-19f4-4355-8309-fb3279d9b5e3] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:49:01.895479 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-41bf6cee-fd27-465c-aaa1-5e7978dbd88b tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:01.895914 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-41bf6cee-fd27-465c-aaa1-5e7978dbd88b tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:01.896666 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-41bf6cee-fd27-465c-aaa1-5e7978dbd88b tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:01.897091 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-41bf6cee-fd27-465c-aaa1-5e7978dbd88b tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:01.959030 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-41bf6cee-fd27-465c-aaa1-5e7978dbd88b tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3/ips" status: 200 len: 149 microversion: 2.1 time: 0.080993 Apr 08 02:49:01.959601 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 179/354] 10.222.0.48 () {58 vars in 1247 bytes} [Fri Apr 8 02:49:01 2022] GET /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3/ips => generated 149 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:49:03.438714 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-afedac09-67e4-4cba-914c-f69ed7a69a46 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0e193ec0-2248-42d7-8834-e4992c0590f3"}} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:49:03.439851 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-afedac09-67e4-4cba-914c-f69ed7a69a46 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 09e6abc6-19f4-4355-8309-fb3279d9b5e3] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:49:03.447021 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-afedac09-67e4-4cba-914c-f69ed7a69a46 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:03.447468 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-afedac09-67e4-4cba-914c-f69ed7a69a46 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:03.448247 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-afedac09-67e4-4cba-914c-f69ed7a69a46 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:03.448683 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-afedac09-67e4-4cba-914c-f69ed7a69a46 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:03.701747 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-862c9999-f0a4-4209-b86a-644513287dad tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:49:03.702282 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-862c9999-f0a4-4209-b86a-644513287dad tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:49:03.709905 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-862c9999-f0a4-4209-b86a-644513287dad tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:03.710633 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-862c9999-f0a4-4209-b86a-644513287dad tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:03.711831 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-862c9999-f0a4-4209-b86a-644513287dad tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:03.712473 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-862c9999-f0a4-4209-b86a-644513287dad tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:03.777882 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.objects.instance [None req-862c9999-f0a4-4209-b86a-644513287dad tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lazy-loading 'flavor' on Instance uuid e44bc1d2-0741-4081-9165-b0aca9008eaf {{(pid=96920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 08 02:49:03.800230 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-afedac09-67e4-4cba-914c-f69ed7a69a46 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "POST /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.370585 Apr 08 02:49:03.800830 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 176/355] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Apr 8 02:49:03 2022] POST /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3/os-volume_attachments => generated 194 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:49:04.133179 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-862c9999-f0a4-4209-b86a-644513287dad tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "POST /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf/action" status: 202 len: 0 microversion: 2.20 time: 0.440268 Apr 08 02:49:04.139090 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 180/356] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Apr 8 02:49:03 2022] POST /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf/action => generated 0 bytes in 447 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 08 02:49:04.150073 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-27d8e0fc-d95a-4f5c-a14d-e6a61c91f0e0 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:04.150965 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-27d8e0fc-d95a-4f5c-a14d-e6a61c91f0e0 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:49:04.172195 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-27d8e0fc-d95a-4f5c-a14d-e6a61c91f0e0 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:04.172913 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-27d8e0fc-d95a-4f5c-a14d-e6a61c91f0e0 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:04.174184 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-27d8e0fc-d95a-4f5c-a14d-e6a61c91f0e0 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:04.175126 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-27d8e0fc-d95a-4f5c-a14d-e6a61c91f0e0 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:04.420248 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-27d8e0fc-d95a-4f5c-a14d-e6a61c91f0e0 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:04.433418 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-27d8e0fc-d95a-4f5c-a14d-e6a61c91f0e0 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:04.439647 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-27d8e0fc-d95a-4f5c-a14d-e6a61c91f0e0 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:04.440744 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-27d8e0fc-d95a-4f5c-a14d-e6a61c91f0e0 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1725 microversion: 2.20 time: 0.300930 Apr 08 02:49:04.441264 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 177/357] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:49:04 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1725 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 02:49:05.466209 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-e4eda8f7-e475-4204-855f-7a7da1f1fd8b tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:05.466930 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-e4eda8f7-e475-4204-855f-7a7da1f1fd8b tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:49:05.474562 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-e4eda8f7-e475-4204-855f-7a7da1f1fd8b tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:05.475037 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-e4eda8f7-e475-4204-855f-7a7da1f1fd8b tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:05.475887 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-e4eda8f7-e475-4204-855f-7a7da1f1fd8b tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:05.476326 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-e4eda8f7-e475-4204-855f-7a7da1f1fd8b tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:05.678915 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-e4eda8f7-e475-4204-855f-7a7da1f1fd8b tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:05.692666 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-e4eda8f7-e475-4204-855f-7a7da1f1fd8b tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:05.698959 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-e4eda8f7-e475-4204-855f-7a7da1f1fd8b tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:05.700327 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-e4eda8f7-e475-4204-855f-7a7da1f1fd8b tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1725 microversion: 2.20 time: 0.243875 Apr 08 02:49:05.700862 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 181/358] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:49:05 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1725 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:49:06.723811 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-d10eae4a-4db6-4e97-b831-0b31e6f86269 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:06.724420 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-d10eae4a-4db6-4e97-b831-0b31e6f86269 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:49:06.733534 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-d10eae4a-4db6-4e97-b831-0b31e6f86269 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:06.733975 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-d10eae4a-4db6-4e97-b831-0b31e6f86269 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:06.734779 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-d10eae4a-4db6-4e97-b831-0b31e6f86269 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:06.735214 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-d10eae4a-4db6-4e97-b831-0b31e6f86269 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:06.945643 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-d10eae4a-4db6-4e97-b831-0b31e6f86269 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:06.959152 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-d10eae4a-4db6-4e97-b831-0b31e6f86269 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:06.965830 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-d10eae4a-4db6-4e97-b831-0b31e6f86269 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:06.966938 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-d10eae4a-4db6-4e97-b831-0b31e6f86269 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1725 microversion: 2.20 time: 0.252705 Apr 08 02:49:06.967462 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 178/359] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:49:06 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1725 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:49:07.990966 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-076ea588-248d-47e8-8e14-3ebaace9d3ac tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:07.991675 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-076ea588-248d-47e8-8e14-3ebaace9d3ac tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:49:07.998974 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-076ea588-248d-47e8-8e14-3ebaace9d3ac tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:07.999411 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-076ea588-248d-47e8-8e14-3ebaace9d3ac tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:08.000245 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-076ea588-248d-47e8-8e14-3ebaace9d3ac tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:08.000666 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-076ea588-248d-47e8-8e14-3ebaace9d3ac tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:08.215930 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-076ea588-248d-47e8-8e14-3ebaace9d3ac tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:08.229802 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-076ea588-248d-47e8-8e14-3ebaace9d3ac tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:08.237221 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-076ea588-248d-47e8-8e14-3ebaace9d3ac tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:08.238328 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-076ea588-248d-47e8-8e14-3ebaace9d3ac tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1725 microversion: 2.20 time: 0.256623 Apr 08 02:49:08.238866 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 182/360] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:49:07 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1725 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:49:08.544858 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-5d61e9ef-585f-4128-b4be-88aa6c6a55ab tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-411859011", "imageRef": "7f8ca061-f382-4052-8d05-69f37e107684", "flavorRef": "452", "networks": [{"uuid": "56fa5162-5751-457a-9e46-87c248750bb3"}]}} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:49:08.613758 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.network.neutron [None req-5d61e9ef-585f-4128-b4be-88aa6c6a55ab tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] validate_networks() for [('56fa5162-5751-457a-9e46-87c248750bb3', None, None, None)] {{(pid=96919) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} Apr 08 02:49:09.162469 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.virt.hardware [None req-5d61e9ef-585f-4128-b4be-88aa6c6a55ab tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Flavor limits 0:0:0 {{(pid=96919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} Apr 08 02:49:09.162908 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.virt.hardware [None req-5d61e9ef-585f-4128-b4be-88aa6c6a55ab tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Image limits 0:0:0 {{(pid=96919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} Apr 08 02:49:09.163373 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.virt.hardware [None req-5d61e9ef-585f-4128-b4be-88aa6c6a55ab tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Flavor pref 0:0:0 {{(pid=96919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} Apr 08 02:49:09.163772 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.virt.hardware [None req-5d61e9ef-585f-4128-b4be-88aa6c6a55ab tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Image pref 0:0:0 {{(pid=96919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} Apr 08 02:49:09.164173 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.virt.hardware [None req-5d61e9ef-585f-4128-b4be-88aa6c6a55ab tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=96919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} Apr 08 02:49:09.173094 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-5d61e9ef-585f-4128-b4be-88aa6c6a55ab tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:09.173533 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-5d61e9ef-585f-4128-b4be-88aa6c6a55ab tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:09.174322 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-5d61e9ef-585f-4128-b4be-88aa6c6a55ab tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:09.174800 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-5d61e9ef-585f-4128-b4be-88aa6c6a55ab tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:09.192637 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.quota [None req-5d61e9ef-585f-4128-b4be-88aa6c6a55ab tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Getting quotas for project 5fb44db14d6e4c14b82c05f28e8ee9d9. Resources: {'instances', 'cores', 'ram'} {{(pid=96919) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:49:09.196503 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.quota [None req-5d61e9ef-585f-4128-b4be-88aa6c6a55ab tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Getting quotas for user 6b94017d79f24adaa76748899bc7c014 and project 5fb44db14d6e4c14b82c05f28e8ee9d9. Resources: {'instances', 'cores', 'ram'} {{(pid=96919) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:49:09.206594 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-5d61e9ef-585f-4128-b4be-88aa6c6a55ab tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Going to run 1 instances... {{(pid=96919) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} Apr 08 02:49:09.208900 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-5d61e9ef-585f-4128-b4be-88aa6c6a55ab tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] [instance: 59d316c0-ed6c-470a-b33f-30b42537143f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7f8ca061-f382-4052-8d05-69f37e107684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=96919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} Apr 08 02:49:09.252410 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5d61e9ef-585f-4128-b4be-88aa6c6a55ab tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] [9ae88256-6757-40bb-a232-b537664e9955] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 08 02:49:09.261777 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-5a80d93f-9bc0-42f7-8c76-c6588b1a9089 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:09.262372 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-5a80d93f-9bc0-42f7-8c76-c6588b1a9089 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:49:09.269953 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-5a80d93f-9bc0-42f7-8c76-c6588b1a9089 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:09.270332 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-5a80d93f-9bc0-42f7-8c76-c6588b1a9089 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:09.271335 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-5a80d93f-9bc0-42f7-8c76-c6588b1a9089 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:09.271822 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-5a80d93f-9bc0-42f7-8c76-c6588b1a9089 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:09.480902 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-5a80d93f-9bc0-42f7-8c76-c6588b1a9089 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:09.494313 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-5a80d93f-9bc0-42f7-8c76-c6588b1a9089 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:09.500605 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-5a80d93f-9bc0-42f7-8c76-c6588b1a9089 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:09.501733 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-5a80d93f-9bc0-42f7-8c76-c6588b1a9089 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1725 microversion: 2.20 time: 0.249404 Apr 08 02:49:09.502252 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 183/361] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:49:09 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1725 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 02:49:10.270210 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO oslo.messaging._drivers.impl_rabbit [None req-5d61e9ef-585f-4128-b4be-88aa6c6a55ab tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] [9ae88256-6757-40bb-a232-b537664e9955] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 49002. Apr 08 02:49:10.273967 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-5d61e9ef-585f-4128-b4be-88aa6c6a55ab tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.738626 Apr 08 02:49:10.274858 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 179/362] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Apr 8 02:49:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1740 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 08 02:49:10.290393 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-c2173dfe-70e1-4a1f-a26c-b63bceaaf282 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:10.291224 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-c2173dfe-70e1-4a1f-a26c-b63bceaaf282 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] [instance: 59d316c0-ed6c-470a-b33f-30b42537143f] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:49:10.377089 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-c2173dfe-70e1-4a1f-a26c-b63bceaaf282 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94017d79f24adaa76748899bc7c014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fb44db14d6e4c14b82c05f28e8ee9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:10.385020 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-c2173dfe-70e1-4a1f-a26c-b63bceaaf282 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] 10.222.0.48 "GET /compute/v2.1/servers/59d316c0-ed6c-470a-b33f-30b42537143f" status: 200 len: 1218 microversion: 2.1 time: 0.104574 Apr 08 02:49:10.385754 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 184/363] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:49:10 2022] GET /compute/v2.1/servers/59d316c0-ed6c-470a-b33f-30b42537143f => generated 1218 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:49:10.525117 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-d1a5f0ea-7d8b-454b-a226-3d4ccc068ed3 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:10.525746 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-d1a5f0ea-7d8b-454b-a226-3d4ccc068ed3 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:49:10.537355 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-d1a5f0ea-7d8b-454b-a226-3d4ccc068ed3 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:10.537800 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-d1a5f0ea-7d8b-454b-a226-3d4ccc068ed3 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:10.538577 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-d1a5f0ea-7d8b-454b-a226-3d4ccc068ed3 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:10.539080 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-d1a5f0ea-7d8b-454b-a226-3d4ccc068ed3 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:10.746956 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-d1a5f0ea-7d8b-454b-a226-3d4ccc068ed3 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:10.760797 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-d1a5f0ea-7d8b-454b-a226-3d4ccc068ed3 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:10.767745 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-d1a5f0ea-7d8b-454b-a226-3d4ccc068ed3 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:10.768999 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-d1a5f0ea-7d8b-454b-a226-3d4ccc068ed3 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1725 microversion: 2.20 time: 0.253529 Apr 08 02:49:10.769526 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 180/364] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:49:10 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1725 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:49:11.408040 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-7acb3275-c671-4833-be81-173997de157d tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:11.408646 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-7acb3275-c671-4833-be81-173997de157d tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] [instance: 59d316c0-ed6c-470a-b33f-30b42537143f] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:49:11.416745 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-7acb3275-c671-4833-be81-173997de157d tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:11.417436 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-7acb3275-c671-4833-be81-173997de157d tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:11.419311 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-7acb3275-c671-4833-be81-173997de157d tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:11.422482 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-7acb3275-c671-4833-be81-173997de157d tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:11.572627 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-7acb3275-c671-4833-be81-173997de157d tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94017d79f24adaa76748899bc7c014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fb44db14d6e4c14b82c05f28e8ee9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:11.580948 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-7acb3275-c671-4833-be81-173997de157d tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] 10.222.0.48 "GET /compute/v2.1/servers/59d316c0-ed6c-470a-b33f-30b42537143f" status: 200 len: 1288 microversion: 2.1 time: 0.182160 Apr 08 02:49:11.581631 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 185/365] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:49:11 2022] GET /compute/v2.1/servers/59d316c0-ed6c-470a-b33f-30b42537143f => generated 1288 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:49:11.793967 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-cbd22d2d-4b9a-4d47-9e29-6ccfafc1ea57 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:11.794636 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-cbd22d2d-4b9a-4d47-9e29-6ccfafc1ea57 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:49:11.801863 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-cbd22d2d-4b9a-4d47-9e29-6ccfafc1ea57 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:11.802292 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-cbd22d2d-4b9a-4d47-9e29-6ccfafc1ea57 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:11.803103 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-cbd22d2d-4b9a-4d47-9e29-6ccfafc1ea57 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:11.803537 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-cbd22d2d-4b9a-4d47-9e29-6ccfafc1ea57 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:12.015757 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-cbd22d2d-4b9a-4d47-9e29-6ccfafc1ea57 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:12.032519 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-cbd22d2d-4b9a-4d47-9e29-6ccfafc1ea57 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:12.038990 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-cbd22d2d-4b9a-4d47-9e29-6ccfafc1ea57 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:12.040139 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-cbd22d2d-4b9a-4d47-9e29-6ccfafc1ea57 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1725 microversion: 2.20 time: 0.256119 Apr 08 02:49:12.040671 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 181/366] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:49:11 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1725 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:49:12.603114 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-580ca34d-86eb-4dc8-86a3-74b43c5ff201 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:12.603717 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-580ca34d-86eb-4dc8-86a3-74b43c5ff201 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] [instance: 59d316c0-ed6c-470a-b33f-30b42537143f] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:49:12.612572 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-580ca34d-86eb-4dc8-86a3-74b43c5ff201 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:12.613016 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-580ca34d-86eb-4dc8-86a3-74b43c5ff201 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:12.613791 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-580ca34d-86eb-4dc8-86a3-74b43c5ff201 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:12.614216 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-580ca34d-86eb-4dc8-86a3-74b43c5ff201 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:12.826839 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-580ca34d-86eb-4dc8-86a3-74b43c5ff201 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94017d79f24adaa76748899bc7c014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fb44db14d6e4c14b82c05f28e8ee9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:12.835002 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-580ca34d-86eb-4dc8-86a3-74b43c5ff201 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] 10.222.0.48 "GET /compute/v2.1/servers/59d316c0-ed6c-470a-b33f-30b42537143f" status: 200 len: 1318 microversion: 2.1 time: 0.241585 Apr 08 02:49:12.835563 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 186/367] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:49:12 2022] GET /compute/v2.1/servers/59d316c0-ed6c-470a-b33f-30b42537143f => generated 1318 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:49:13.064145 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-1cfa16ac-e0cc-4e7b-b554-5191b77b94a8 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:13.064680 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-1cfa16ac-e0cc-4e7b-b554-5191b77b94a8 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:49:13.072938 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-1cfa16ac-e0cc-4e7b-b554-5191b77b94a8 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:13.073368 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-1cfa16ac-e0cc-4e7b-b554-5191b77b94a8 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:13.075199 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-1cfa16ac-e0cc-4e7b-b554-5191b77b94a8 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:13.075818 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-1cfa16ac-e0cc-4e7b-b554-5191b77b94a8 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:13.201138 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [req-0553980c-c2b7-4373-930c-97ac4dd07d97 req-b1385c0a-65bb-4385-99db-1616576ca9e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59d316c0-ed6c-470a-b33f-30b42537143f", "tag": "ee406698-29e8-4d95-b213-93379362182c"}]} {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:49:13.208847 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:49:13.208847 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: warnings.warn(msg) Apr 08 02:49:13.217871 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-0553980c-c2b7-4373-930c-97ac4dd07d97 req-b1385c0a-65bb-4385-99db-1616576ca9e6 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:13.218415 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-0553980c-c2b7-4373-930c-97ac4dd07d97 req-b1385c0a-65bb-4385-99db-1616576ca9e6 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:13.239091 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.compute.server_external_events [req-0553980c-c2b7-4373-930c-97ac4dd07d97 req-b1385c0a-65bb-4385-99db-1616576ca9e6 service nova] Creating event network-changed:ee406698-29e8-4d95-b213-93379362182c for instance 59d316c0-ed6c-470a-b33f-30b42537143f on hv-cinder-83705 Apr 08 02:49:13.244136 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [req-0553980c-c2b7-4373-930c-97ac4dd07d97 req-b1385c0a-65bb-4385-99db-1616576ca9e6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057199 Apr 08 02:49:13.244880 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 187/368] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:49:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:49:13.298552 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-1cfa16ac-e0cc-4e7b-b554-5191b77b94a8 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:13.311936 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-1cfa16ac-e0cc-4e7b-b554-5191b77b94a8 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:13.317973 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-1cfa16ac-e0cc-4e7b-b554-5191b77b94a8 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:13.319051 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-1cfa16ac-e0cc-4e7b-b554-5191b77b94a8 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1725 microversion: 2.20 time: 0.264142 Apr 08 02:49:13.329842 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 182/369] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:49:13 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1725 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 02:49:13.858027 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-76fefba0-2d3a-4cc0-8d53-21dc3193c134 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:13.858654 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-76fefba0-2d3a-4cc0-8d53-21dc3193c134 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] [instance: 59d316c0-ed6c-470a-b33f-30b42537143f] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:49:13.866148 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-76fefba0-2d3a-4cc0-8d53-21dc3193c134 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:13.866619 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-76fefba0-2d3a-4cc0-8d53-21dc3193c134 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:13.867474 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-76fefba0-2d3a-4cc0-8d53-21dc3193c134 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:13.867932 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-76fefba0-2d3a-4cc0-8d53-21dc3193c134 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:14.080595 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-76fefba0-2d3a-4cc0-8d53-21dc3193c134 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94017d79f24adaa76748899bc7c014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fb44db14d6e4c14b82c05f28e8ee9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:14.089334 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-76fefba0-2d3a-4cc0-8d53-21dc3193c134 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] 10.222.0.48 "GET /compute/v2.1/servers/59d316c0-ed6c-470a-b33f-30b42537143f" status: 200 len: 1318 microversion: 2.1 time: 0.241192 Apr 08 02:49:14.090425 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 188/370] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:49:13 2022] GET /compute/v2.1/servers/59d316c0-ed6c-470a-b33f-30b42537143f => generated 1318 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:49:14.342555 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-7d8f2d28-be8a-4d87-a50d-892eb7364763 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:14.343298 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-7d8f2d28-be8a-4d87-a50d-892eb7364763 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:49:14.350219 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-7d8f2d28-be8a-4d87-a50d-892eb7364763 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:14.350688 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-7d8f2d28-be8a-4d87-a50d-892eb7364763 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:14.351464 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-7d8f2d28-be8a-4d87-a50d-892eb7364763 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:14.351896 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-7d8f2d28-be8a-4d87-a50d-892eb7364763 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:14.561857 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-7d8f2d28-be8a-4d87-a50d-892eb7364763 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:14.576370 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-7d8f2d28-be8a-4d87-a50d-892eb7364763 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:14.582420 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-7d8f2d28-be8a-4d87-a50d-892eb7364763 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:14.583567 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-7d8f2d28-be8a-4d87-a50d-892eb7364763 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1725 microversion: 2.20 time: 0.250205 Apr 08 02:49:14.584093 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 183/371] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:49:14 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1725 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:49:15.111733 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-c1ff5e70-f79a-4c01-98d3-fc95e39bb143 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:15.112323 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-c1ff5e70-f79a-4c01-98d3-fc95e39bb143 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] [instance: 59d316c0-ed6c-470a-b33f-30b42537143f] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:49:15.119572 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c1ff5e70-f79a-4c01-98d3-fc95e39bb143 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:15.120008 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c1ff5e70-f79a-4c01-98d3-fc95e39bb143 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:15.120757 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c1ff5e70-f79a-4c01-98d3-fc95e39bb143 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:15.121181 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c1ff5e70-f79a-4c01-98d3-fc95e39bb143 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:15.325713 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-c1ff5e70-f79a-4c01-98d3-fc95e39bb143 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94017d79f24adaa76748899bc7c014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fb44db14d6e4c14b82c05f28e8ee9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:15.333784 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-c1ff5e70-f79a-4c01-98d3-fc95e39bb143 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] 10.222.0.48 "GET /compute/v2.1/servers/59d316c0-ed6c-470a-b33f-30b42537143f" status: 200 len: 1318 microversion: 2.1 time: 0.231065 Apr 08 02:49:15.334300 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 189/372] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:49:15 2022] GET /compute/v2.1/servers/59d316c0-ed6c-470a-b33f-30b42537143f => generated 1318 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:49:15.605775 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-1c6d0125-d1cd-45f2-9ca4-86d10057c9ff tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:15.606358 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-1c6d0125-d1cd-45f2-9ca4-86d10057c9ff tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:49:15.614230 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-1c6d0125-d1cd-45f2-9ca4-86d10057c9ff tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:15.614879 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-1c6d0125-d1cd-45f2-9ca4-86d10057c9ff tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:15.618054 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-1c6d0125-d1cd-45f2-9ca4-86d10057c9ff tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:15.618624 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-1c6d0125-d1cd-45f2-9ca4-86d10057c9ff tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:15.836343 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-1c6d0125-d1cd-45f2-9ca4-86d10057c9ff tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:15.851138 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-1c6d0125-d1cd-45f2-9ca4-86d10057c9ff tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:15.859828 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-1c6d0125-d1cd-45f2-9ca4-86d10057c9ff tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:15.859828 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-1c6d0125-d1cd-45f2-9ca4-86d10057c9ff tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1725 microversion: 2.20 time: 0.262254 Apr 08 02:49:15.859828 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 184/373] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:49:15 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1725 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:49:15.962526 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-de31ef62-cd59-4dfb-b2e6-39a1c5130178 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Action: 'create', calling method: .version_select at 0x7f7d4e2af670>, body: {"keypair": {"name": "tempest-keypair-1257595415"}} {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:49:15.990034 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.quota [None req-de31ef62-cd59-4dfb-b2e6-39a1c5130178 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Getting quotas for project cbbf5bb7e51d4d2d8594d6d1d3a797a3. Resources: {'key_pairs'} {{(pid=96920) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:49:15.993935 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.quota [None req-de31ef62-cd59-4dfb-b2e6-39a1c5130178 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Getting quotas for user b68bc45984974d6da1c9151c21dae14c and project cbbf5bb7e51d4d2d8594d6d1d3a797a3. Resources: {'key_pairs'} {{(pid=96920) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:49:16.206054 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.quota [None req-de31ef62-cd59-4dfb-b2e6-39a1c5130178 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Getting quotas for project cbbf5bb7e51d4d2d8594d6d1d3a797a3. Resources: {'key_pairs'} {{(pid=96920) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:49:16.209789 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.quota [None req-de31ef62-cd59-4dfb-b2e6-39a1c5130178 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Getting quotas for user b68bc45984974d6da1c9151c21dae14c and project cbbf5bb7e51d4d2d8594d6d1d3a797a3. Resources: {'key_pairs'} {{(pid=96920) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:49:16.223396 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-de31ef62-cd59-4dfb-b2e6-39a1c5130178 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.269779 Apr 08 02:49:16.223985 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 190/374] 10.222.0.48 () {60 vars in 1157 bytes} [Fri Apr 8 02:49:15 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:49:16.356593 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-fe19fff5-e3f9-4034-95a5-2d356a052ea3 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:16.357198 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-fe19fff5-e3f9-4034-95a5-2d356a052ea3 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] [instance: 59d316c0-ed6c-470a-b33f-30b42537143f] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:49:16.364353 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-fe19fff5-e3f9-4034-95a5-2d356a052ea3 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:16.364784 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-fe19fff5-e3f9-4034-95a5-2d356a052ea3 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:16.365792 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-fe19fff5-e3f9-4034-95a5-2d356a052ea3 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:16.366295 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-fe19fff5-e3f9-4034-95a5-2d356a052ea3 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:16.670658 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-fe19fff5-e3f9-4034-95a5-2d356a052ea3 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94017d79f24adaa76748899bc7c014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fb44db14d6e4c14b82c05f28e8ee9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:16.678985 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-fe19fff5-e3f9-4034-95a5-2d356a052ea3 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] 10.222.0.48 "GET /compute/v2.1/servers/59d316c0-ed6c-470a-b33f-30b42537143f" status: 200 len: 1318 microversion: 2.1 time: 0.332573 Apr 08 02:49:16.679528 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 185/375] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:49:16 2022] GET /compute/v2.1/servers/59d316c0-ed6c-470a-b33f-30b42537143f => generated 1318 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:49:16.884803 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-115b64d7-94f9-4084-bd78-824e471dffc2 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:16.885464 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-115b64d7-94f9-4084-bd78-824e471dffc2 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:49:16.893643 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-115b64d7-94f9-4084-bd78-824e471dffc2 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:16.894088 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-115b64d7-94f9-4084-bd78-824e471dffc2 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:16.894931 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-115b64d7-94f9-4084-bd78-824e471dffc2 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:16.895354 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-115b64d7-94f9-4084-bd78-824e471dffc2 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:17.196343 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-115b64d7-94f9-4084-bd78-824e471dffc2 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:17.210327 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-115b64d7-94f9-4084-bd78-824e471dffc2 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:17.216721 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-115b64d7-94f9-4084-bd78-824e471dffc2 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:17.217819 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-115b64d7-94f9-4084-bd78-824e471dffc2 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1725 microversion: 2.20 time: 0.344548 Apr 08 02:49:17.218333 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 191/376] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:49:16 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1725 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:49:17.707687 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-0d7e2c4e-e861-448c-a4bb-da2064b388b7 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:17.708296 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-0d7e2c4e-e861-448c-a4bb-da2064b388b7 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] [instance: 59d316c0-ed6c-470a-b33f-30b42537143f] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:49:17.716891 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-0d7e2c4e-e861-448c-a4bb-da2064b388b7 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:17.717413 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-0d7e2c4e-e861-448c-a4bb-da2064b388b7 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:17.718260 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-0d7e2c4e-e861-448c-a4bb-da2064b388b7 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:17.718791 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-0d7e2c4e-e861-448c-a4bb-da2064b388b7 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:18.099894 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-0d7e2c4e-e861-448c-a4bb-da2064b388b7 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94017d79f24adaa76748899bc7c014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fb44db14d6e4c14b82c05f28e8ee9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:18.108168 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-0d7e2c4e-e861-448c-a4bb-da2064b388b7 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] 10.222.0.48 "GET /compute/v2.1/servers/59d316c0-ed6c-470a-b33f-30b42537143f" status: 200 len: 1318 microversion: 2.1 time: 0.410357 Apr 08 02:49:18.109237 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 186/377] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:49:17 2022] GET /compute/v2.1/servers/59d316c0-ed6c-470a-b33f-30b42537143f => generated 1318 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:49:18.244210 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-e7b1b181-09f3-44bc-94ad-b994d795493f tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:18.244880 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-e7b1b181-09f3-44bc-94ad-b994d795493f tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:49:18.252073 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-e7b1b181-09f3-44bc-94ad-b994d795493f tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:18.252513 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-e7b1b181-09f3-44bc-94ad-b994d795493f tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:18.253291 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-e7b1b181-09f3-44bc-94ad-b994d795493f tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:18.253726 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-e7b1b181-09f3-44bc-94ad-b994d795493f tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:18.422358 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-1adb3070-776e-402d-a961-b9fa880c8b5a tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-417775950", "imageRef": "7f8ca061-f382-4052-8d05-69f37e107684", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8b5bf61a-9182-47e6-a758-1a71619fdd20"}], "security_groups": [{"name": "tempest-securitygroup--1397460970"}], "key_name": "tempest-keypair-1257595415", "user_data": "}} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:49:18.578757 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.network.neutron [None req-1adb3070-776e-402d-a961-b9fa880c8b5a tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] validate_networks() for [('8b5bf61a-9182-47e6-a758-1a71619fdd20', None, None, None)] {{(pid=96919) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} Apr 08 02:49:18.757663 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-e7b1b181-09f3-44bc-94ad-b994d795493f tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:18.773626 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-e7b1b181-09f3-44bc-94ad-b994d795493f tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:18.780023 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-e7b1b181-09f3-44bc-94ad-b994d795493f tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:18.781152 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-e7b1b181-09f3-44bc-94ad-b994d795493f tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1725 microversion: 2.20 time: 0.548667 Apr 08 02:49:18.781824 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 192/378] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:49:18 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1725 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:49:19.130142 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-5c227def-407d-4767-870d-b5e9b31a70b9 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:19.130779 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-5c227def-407d-4767-870d-b5e9b31a70b9 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] [instance: 59d316c0-ed6c-470a-b33f-30b42537143f] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:49:19.138848 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-5c227def-407d-4767-870d-b5e9b31a70b9 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:19.139299 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-5c227def-407d-4767-870d-b5e9b31a70b9 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:19.140077 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-5c227def-407d-4767-870d-b5e9b31a70b9 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:19.140515 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-5c227def-407d-4767-870d-b5e9b31a70b9 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:19.162239 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.virt.hardware [None req-1adb3070-776e-402d-a961-b9fa880c8b5a tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Flavor limits 0:0:0 {{(pid=96919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} Apr 08 02:49:19.163334 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.virt.hardware [None req-1adb3070-776e-402d-a961-b9fa880c8b5a tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Image limits 0:0:0 {{(pid=96919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} Apr 08 02:49:19.163812 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.virt.hardware [None req-1adb3070-776e-402d-a961-b9fa880c8b5a tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Flavor pref 0:0:0 {{(pid=96919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} Apr 08 02:49:19.164270 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.virt.hardware [None req-1adb3070-776e-402d-a961-b9fa880c8b5a tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Image pref 0:0:0 {{(pid=96919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} Apr 08 02:49:19.165149 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.virt.hardware [None req-1adb3070-776e-402d-a961-b9fa880c8b5a tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=96919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} Apr 08 02:49:19.174478 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-1adb3070-776e-402d-a961-b9fa880c8b5a tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:19.175058 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-1adb3070-776e-402d-a961-b9fa880c8b5a tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:19.175882 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-1adb3070-776e-402d-a961-b9fa880c8b5a tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:19.176430 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-1adb3070-776e-402d-a961-b9fa880c8b5a tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:19.194733 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.quota [None req-1adb3070-776e-402d-a961-b9fa880c8b5a tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Getting quotas for project cbbf5bb7e51d4d2d8594d6d1d3a797a3. Resources: {'instances', 'cores', 'ram'} {{(pid=96919) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:49:19.198826 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.quota [None req-1adb3070-776e-402d-a961-b9fa880c8b5a tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Getting quotas for user b68bc45984974d6da1c9151c21dae14c and project cbbf5bb7e51d4d2d8594d6d1d3a797a3. Resources: {'instances', 'cores', 'ram'} {{(pid=96919) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:49:19.210007 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-1adb3070-776e-402d-a961-b9fa880c8b5a tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Going to run 1 instances... {{(pid=96919) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} Apr 08 02:49:19.212203 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-1adb3070-776e-402d-a961-b9fa880c8b5a tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: de7be542-3f1f-4b34-a68c-4500efe9f8d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7f8ca061-f382-4052-8d05-69f37e107684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=96919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} Apr 08 02:49:19.260198 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-1adb3070-776e-402d-a961-b9fa880c8b5a tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.850423 Apr 08 02:49:19.260932 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 187/379] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Apr 8 02:49:18 2022] POST /compute/v2.1/servers => generated 402 bytes in 852 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 08 02:49:19.276518 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-2ce82b90-d6a3-487d-87eb-ea77947d011a tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:19.277654 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-2ce82b90-d6a3-487d-87eb-ea77947d011a tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: de7be542-3f1f-4b34-a68c-4500efe9f8d9] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:49:19.373404 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-2ce82b90-d6a3-487d-87eb-ea77947d011a tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68bc45984974d6da1c9151c21dae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbf5bb7e51d4d2d8594d6d1d3a797a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:19.381994 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-2ce82b90-d6a3-487d-87eb-ea77947d011a tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/de7be542-3f1f-4b34-a68c-4500efe9f8d9" status: 200 len: 1241 microversion: 2.1 time: 0.114190 Apr 08 02:49:19.392404 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 188/380] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:49:19 2022] GET /compute/v2.1/servers/de7be542-3f1f-4b34-a68c-4500efe9f8d9 => generated 1241 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:49:19.452000 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-5c227def-407d-4767-870d-b5e9b31a70b9 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94017d79f24adaa76748899bc7c014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fb44db14d6e4c14b82c05f28e8ee9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:19.460363 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-5c227def-407d-4767-870d-b5e9b31a70b9 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] 10.222.0.48 "GET /compute/v2.1/servers/59d316c0-ed6c-470a-b33f-30b42537143f" status: 200 len: 1318 microversion: 2.1 time: 0.340039 Apr 08 02:49:19.461101 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 193/381] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:49:19 2022] GET /compute/v2.1/servers/59d316c0-ed6c-470a-b33f-30b42537143f => generated 1318 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:49:19.804111 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-9b07e61b-afa3-4802-a317-bff0a0a46dcc tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:19.804707 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-9b07e61b-afa3-4802-a317-bff0a0a46dcc tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:49:19.812228 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-9b07e61b-afa3-4802-a317-bff0a0a46dcc tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:19.812660 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-9b07e61b-afa3-4802-a317-bff0a0a46dcc tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:19.813448 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-9b07e61b-afa3-4802-a317-bff0a0a46dcc tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:19.813870 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-9b07e61b-afa3-4802-a317-bff0a0a46dcc tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:20.019117 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-9b07e61b-afa3-4802-a317-bff0a0a46dcc tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:20.032193 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-9b07e61b-afa3-4802-a317-bff0a0a46dcc tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:20.038155 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-9b07e61b-afa3-4802-a317-bff0a0a46dcc tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:20.039278 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-9b07e61b-afa3-4802-a317-bff0a0a46dcc tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1725 microversion: 2.20 time: 0.244311 Apr 08 02:49:20.039795 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 189/382] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:49:19 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1725 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:49:20.404823 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-3fac07ec-62e6-45dc-9714-c164419c283c tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:20.405428 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-3fac07ec-62e6-45dc-9714-c164419c283c tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: de7be542-3f1f-4b34-a68c-4500efe9f8d9] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:49:20.413275 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-3fac07ec-62e6-45dc-9714-c164419c283c tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:20.413716 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-3fac07ec-62e6-45dc-9714-c164419c283c tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:20.415943 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-3fac07ec-62e6-45dc-9714-c164419c283c tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:20.416379 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-3fac07ec-62e6-45dc-9714-c164419c283c tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:20.486058 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-26da5154-761c-4c47-b745-66ad5c8c4600 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:20.486768 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-26da5154-761c-4c47-b745-66ad5c8c4600 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] [instance: 59d316c0-ed6c-470a-b33f-30b42537143f] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:49:20.509469 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-26da5154-761c-4c47-b745-66ad5c8c4600 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:20.510011 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-26da5154-761c-4c47-b745-66ad5c8c4600 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:20.510909 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-26da5154-761c-4c47-b745-66ad5c8c4600 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:20.511600 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-26da5154-761c-4c47-b745-66ad5c8c4600 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:20.571733 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-3fac07ec-62e6-45dc-9714-c164419c283c tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68bc45984974d6da1c9151c21dae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbf5bb7e51d4d2d8594d6d1d3a797a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:20.583353 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-3fac07ec-62e6-45dc-9714-c164419c283c tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/de7be542-3f1f-4b34-a68c-4500efe9f8d9" status: 200 len: 1311 microversion: 2.1 time: 0.187743 Apr 08 02:49:20.584067 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 194/383] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:49:20 2022] GET /compute/v2.1/servers/de7be542-3f1f-4b34-a68c-4500efe9f8d9 => generated 1311 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:49:20.750450 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-26da5154-761c-4c47-b745-66ad5c8c4600 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94017d79f24adaa76748899bc7c014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fb44db14d6e4c14b82c05f28e8ee9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:20.758363 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-26da5154-761c-4c47-b745-66ad5c8c4600 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] 10.222.0.48 "GET /compute/v2.1/servers/59d316c0-ed6c-470a-b33f-30b42537143f" status: 200 len: 1318 microversion: 2.1 time: 0.284994 Apr 08 02:49:20.758926 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 190/384] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:49:20 2022] GET /compute/v2.1/servers/59d316c0-ed6c-470a-b33f-30b42537143f => generated 1318 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:49:21.063554 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-dddf2cd5-a751-4118-949a-f19c5601c90c tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:21.064147 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-dddf2cd5-a751-4118-949a-f19c5601c90c tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:49:21.071298 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-dddf2cd5-a751-4118-949a-f19c5601c90c tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:21.071735 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-dddf2cd5-a751-4118-949a-f19c5601c90c tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:21.072612 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-dddf2cd5-a751-4118-949a-f19c5601c90c tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:21.073117 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-dddf2cd5-a751-4118-949a-f19c5601c90c tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:21.294433 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-dddf2cd5-a751-4118-949a-f19c5601c90c tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:21.309710 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-dddf2cd5-a751-4118-949a-f19c5601c90c tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:21.315926 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-dddf2cd5-a751-4118-949a-f19c5601c90c tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:21.317411 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-dddf2cd5-a751-4118-949a-f19c5601c90c tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1725 microversion: 2.20 time: 0.263740 Apr 08 02:49:21.328414 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 195/385] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:49:21 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1725 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:49:21.505698 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [req-03db363d-fd7c-4d30-b9ee-1f12ea84e1d9 req-c3da9444-0925-4a0e-9802-9ecfc2510be4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59d316c0-ed6c-470a-b33f-30b42537143f", "name": "network-vif-plugged", "status": "completed", "tag": "ee406698-29e8-4d95-b213-93379362182c"}]} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:49:21.514044 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:49:21.514044 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: warnings.warn(msg) Apr 08 02:49:21.522522 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-03db363d-fd7c-4d30-b9ee-1f12ea84e1d9 req-c3da9444-0925-4a0e-9802-9ecfc2510be4 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:21.523119 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-03db363d-fd7c-4d30-b9ee-1f12ea84e1d9 req-c3da9444-0925-4a0e-9802-9ecfc2510be4 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:21.541612 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.compute.server_external_events [req-03db363d-fd7c-4d30-b9ee-1f12ea84e1d9 req-c3da9444-0925-4a0e-9802-9ecfc2510be4 service nova] Creating event network-vif-plugged:ee406698-29e8-4d95-b213-93379362182c for instance 59d316c0-ed6c-470a-b33f-30b42537143f on hv-cinder-83705 Apr 08 02:49:21.547864 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [req-03db363d-fd7c-4d30-b9ee-1f12ea84e1d9 req-c3da9444-0925-4a0e-9802-9ecfc2510be4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052913 Apr 08 02:49:21.548709 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 191/386] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:49:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:49:21.615404 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-318a0764-000d-4190-8991-f72fb6464fee tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:21.616028 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-318a0764-000d-4190-8991-f72fb6464fee tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: de7be542-3f1f-4b34-a68c-4500efe9f8d9] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:49:21.629498 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-318a0764-000d-4190-8991-f72fb6464fee tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:21.629939 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-318a0764-000d-4190-8991-f72fb6464fee tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:21.630745 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-318a0764-000d-4190-8991-f72fb6464fee tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:21.631188 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-318a0764-000d-4190-8991-f72fb6464fee tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:21.784127 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-eb0856ae-ce31-434c-8b37-ddaf9d52bed1 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:21.786134 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-eb0856ae-ce31-434c-8b37-ddaf9d52bed1 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] [instance: 59d316c0-ed6c-470a-b33f-30b42537143f] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:49:21.795750 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-eb0856ae-ce31-434c-8b37-ddaf9d52bed1 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:21.796418 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-eb0856ae-ce31-434c-8b37-ddaf9d52bed1 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:21.797461 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-eb0856ae-ce31-434c-8b37-ddaf9d52bed1 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:21.798076 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-eb0856ae-ce31-434c-8b37-ddaf9d52bed1 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:21.852296 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-318a0764-000d-4190-8991-f72fb6464fee tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68bc45984974d6da1c9151c21dae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbf5bb7e51d4d2d8594d6d1d3a797a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:21.863130 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-318a0764-000d-4190-8991-f72fb6464fee tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/de7be542-3f1f-4b34-a68c-4500efe9f8d9" status: 200 len: 1367 microversion: 2.1 time: 0.265491 Apr 08 02:49:21.863664 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 196/387] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:49:21 2022] GET /compute/v2.1/servers/de7be542-3f1f-4b34-a68c-4500efe9f8d9 => generated 1367 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:49:22.040399 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-eb0856ae-ce31-434c-8b37-ddaf9d52bed1 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94017d79f24adaa76748899bc7c014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fb44db14d6e4c14b82c05f28e8ee9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:22.050179 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-eb0856ae-ce31-434c-8b37-ddaf9d52bed1 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] 10.222.0.48 "GET /compute/v2.1/servers/59d316c0-ed6c-470a-b33f-30b42537143f" status: 200 len: 1318 microversion: 2.1 time: 0.277758 Apr 08 02:49:22.050789 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 192/388] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:49:21 2022] GET /compute/v2.1/servers/59d316c0-ed6c-470a-b33f-30b42537143f => generated 1318 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:49:22.342244 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-4a324ffe-be34-474d-941b-51028e24ec1d tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:22.342885 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-4a324ffe-be34-474d-941b-51028e24ec1d tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:49:22.350581 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-4a324ffe-be34-474d-941b-51028e24ec1d tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:22.351049 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-4a324ffe-be34-474d-941b-51028e24ec1d tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:22.351853 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-4a324ffe-be34-474d-941b-51028e24ec1d tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:22.352271 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-4a324ffe-be34-474d-941b-51028e24ec1d tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:22.492879 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [req-07d6c37f-b352-4751-828e-f9064d69fe13 req-baf290a5-d847-4038-9773-4e32d65336b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de7be542-3f1f-4b34-a68c-4500efe9f8d9", "tag": "47e2a2ae-5384-4804-b0be-7c736b7e4b92"}]} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:49:22.501233 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:49:22.501233 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: warnings.warn(msg) Apr 08 02:49:22.516037 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-07d6c37f-b352-4751-828e-f9064d69fe13 req-baf290a5-d847-4038-9773-4e32d65336b5 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:22.516697 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-07d6c37f-b352-4751-828e-f9064d69fe13 req-baf290a5-d847-4038-9773-4e32d65336b5 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:22.539612 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.compute.server_external_events [req-07d6c37f-b352-4751-828e-f9064d69fe13 req-baf290a5-d847-4038-9773-4e32d65336b5 service nova] Creating event network-changed:47e2a2ae-5384-4804-b0be-7c736b7e4b92 for instance de7be542-3f1f-4b34-a68c-4500efe9f8d9 on hv-cinder-83705 Apr 08 02:49:22.545061 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [req-07d6c37f-b352-4751-828e-f9064d69fe13 req-baf290a5-d847-4038-9773-4e32d65336b5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065803 Apr 08 02:49:22.545715 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 193/389] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:49:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 02:49:22.570398 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-4a324ffe-be34-474d-941b-51028e24ec1d tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:22.585180 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-4a324ffe-be34-474d-941b-51028e24ec1d tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:22.592522 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-4a324ffe-be34-474d-941b-51028e24ec1d tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:22.593849 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-4a324ffe-be34-474d-941b-51028e24ec1d tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1746 microversion: 2.20 time: 0.261482 Apr 08 02:49:22.594366 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 197/390] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:49:22 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1746 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:49:22.887651 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-fb620b9c-d397-42ed-8c15-e5cf454e2c41 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:22.888525 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-fb620b9c-d397-42ed-8c15-e5cf454e2c41 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: de7be542-3f1f-4b34-a68c-4500efe9f8d9] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:49:22.895963 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-fb620b9c-d397-42ed-8c15-e5cf454e2c41 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:22.896401 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-fb620b9c-d397-42ed-8c15-e5cf454e2c41 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:22.897157 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-fb620b9c-d397-42ed-8c15-e5cf454e2c41 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:22.897581 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-fb620b9c-d397-42ed-8c15-e5cf454e2c41 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:23.075362 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-4591e338-bf33-4b37-b68b-a774c87dcb52 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:23.076542 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-4591e338-bf33-4b37-b68b-a774c87dcb52 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] [instance: 59d316c0-ed6c-470a-b33f-30b42537143f] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:49:23.084922 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-4591e338-bf33-4b37-b68b-a774c87dcb52 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:23.085364 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-4591e338-bf33-4b37-b68b-a774c87dcb52 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:23.086139 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-4591e338-bf33-4b37-b68b-a774c87dcb52 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:23.086564 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-4591e338-bf33-4b37-b68b-a774c87dcb52 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:23.107328 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-fb620b9c-d397-42ed-8c15-e5cf454e2c41 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68bc45984974d6da1c9151c21dae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbf5bb7e51d4d2d8594d6d1d3a797a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:23.115524 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-fb620b9c-d397-42ed-8c15-e5cf454e2c41 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/de7be542-3f1f-4b34-a68c-4500efe9f8d9" status: 200 len: 1367 microversion: 2.1 time: 0.237914 Apr 08 02:49:23.116432 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 194/391] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:49:22 2022] GET /compute/v2.1/servers/de7be542-3f1f-4b34-a68c-4500efe9f8d9 => generated 1367 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:49:23.296866 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-4591e338-bf33-4b37-b68b-a774c87dcb52 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94017d79f24adaa76748899bc7c014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fb44db14d6e4c14b82c05f28e8ee9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:23.304778 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-4591e338-bf33-4b37-b68b-a774c87dcb52 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] 10.222.0.48 "GET /compute/v2.1/servers/59d316c0-ed6c-470a-b33f-30b42537143f" status: 200 len: 1318 microversion: 2.1 time: 0.239980 Apr 08 02:49:23.305345 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 198/392] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:49:23 2022] GET /compute/v2.1/servers/59d316c0-ed6c-470a-b33f-30b42537143f => generated 1318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:49:23.617363 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-3000110b-09df-43a9-9aa1-2023eb268e84 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:23.617958 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-3000110b-09df-43a9-9aa1-2023eb268e84 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:49:23.625069 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-3000110b-09df-43a9-9aa1-2023eb268e84 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:23.625503 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-3000110b-09df-43a9-9aa1-2023eb268e84 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:23.626265 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-3000110b-09df-43a9-9aa1-2023eb268e84 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:23.626710 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-3000110b-09df-43a9-9aa1-2023eb268e84 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:23.826121 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-3000110b-09df-43a9-9aa1-2023eb268e84 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:23.840144 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-3000110b-09df-43a9-9aa1-2023eb268e84 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:23.846129 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-3000110b-09df-43a9-9aa1-2023eb268e84 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:23.847271 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-3000110b-09df-43a9-9aa1-2023eb268e84 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1746 microversion: 2.20 time: 0.238936 Apr 08 02:49:23.847791 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 195/393] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:49:23 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1746 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:49:24.138573 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-8d46b8c9-303b-4027-b285-8102d4bbf82d tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:24.139192 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-8d46b8c9-303b-4027-b285-8102d4bbf82d tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: de7be542-3f1f-4b34-a68c-4500efe9f8d9] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:49:24.146817 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-8d46b8c9-303b-4027-b285-8102d4bbf82d tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:24.147262 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-8d46b8c9-303b-4027-b285-8102d4bbf82d tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:24.148038 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-8d46b8c9-303b-4027-b285-8102d4bbf82d tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:24.148514 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-8d46b8c9-303b-4027-b285-8102d4bbf82d tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:24.327111 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-716f3ebe-7982-40ce-a372-9638481e3f9f tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:24.327709 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-716f3ebe-7982-40ce-a372-9638481e3f9f tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] [instance: 59d316c0-ed6c-470a-b33f-30b42537143f] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:49:24.335410 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-716f3ebe-7982-40ce-a372-9638481e3f9f tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:24.335853 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-716f3ebe-7982-40ce-a372-9638481e3f9f tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:24.336637 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-716f3ebe-7982-40ce-a372-9638481e3f9f tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:24.337092 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-716f3ebe-7982-40ce-a372-9638481e3f9f tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:24.350420 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-8d46b8c9-303b-4027-b285-8102d4bbf82d tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68bc45984974d6da1c9151c21dae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbf5bb7e51d4d2d8594d6d1d3a797a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:24.358380 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-8d46b8c9-303b-4027-b285-8102d4bbf82d tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/de7be542-3f1f-4b34-a68c-4500efe9f8d9" status: 200 len: 1367 microversion: 2.1 time: 0.229595 Apr 08 02:49:24.358960 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 199/394] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:49:24 2022] GET /compute/v2.1/servers/de7be542-3f1f-4b34-a68c-4500efe9f8d9 => generated 1367 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:49:24.535844 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-716f3ebe-7982-40ce-a372-9638481e3f9f tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94017d79f24adaa76748899bc7c014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fb44db14d6e4c14b82c05f28e8ee9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:24.544541 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-716f3ebe-7982-40ce-a372-9638481e3f9f tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] 10.222.0.48 "GET /compute/v2.1/servers/59d316c0-ed6c-470a-b33f-30b42537143f" status: 200 len: 1318 microversion: 2.1 time: 0.227144 Apr 08 02:49:24.545066 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 196/395] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:49:24 2022] GET /compute/v2.1/servers/59d316c0-ed6c-470a-b33f-30b42537143f => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:49:24.872070 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-3b791960-8353-4587-95cf-7d475394857c tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:24.872661 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-3b791960-8353-4587-95cf-7d475394857c tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:49:24.879778 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-3b791960-8353-4587-95cf-7d475394857c tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:24.880210 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-3b791960-8353-4587-95cf-7d475394857c tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:24.880955 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-3b791960-8353-4587-95cf-7d475394857c tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:24.881373 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-3b791960-8353-4587-95cf-7d475394857c tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:25.087454 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-3b791960-8353-4587-95cf-7d475394857c tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:25.101001 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-3b791960-8353-4587-95cf-7d475394857c tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:25.107370 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-3b791960-8353-4587-95cf-7d475394857c tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:25.108448 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-3b791960-8353-4587-95cf-7d475394857c tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1746 microversion: 2.20 time: 0.245477 Apr 08 02:49:25.108963 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 200/396] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:49:24 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1746 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:49:25.381140 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-ecc485f4-97ff-454e-8124-e029f5705029 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:25.381754 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-ecc485f4-97ff-454e-8124-e029f5705029 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: de7be542-3f1f-4b34-a68c-4500efe9f8d9] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:49:25.390186 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ecc485f4-97ff-454e-8124-e029f5705029 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:25.390623 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ecc485f4-97ff-454e-8124-e029f5705029 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:25.391419 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ecc485f4-97ff-454e-8124-e029f5705029 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:25.391842 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ecc485f4-97ff-454e-8124-e029f5705029 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:25.566369 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-04786a73-1db9-4324-8ca6-73228490fb4e tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:25.567015 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-04786a73-1db9-4324-8ca6-73228490fb4e tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] [instance: 59d316c0-ed6c-470a-b33f-30b42537143f] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:49:25.574743 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-04786a73-1db9-4324-8ca6-73228490fb4e tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:25.575457 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-04786a73-1db9-4324-8ca6-73228490fb4e tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:25.576310 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-04786a73-1db9-4324-8ca6-73228490fb4e tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:25.576831 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-04786a73-1db9-4324-8ca6-73228490fb4e tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:25.605233 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-ecc485f4-97ff-454e-8124-e029f5705029 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68bc45984974d6da1c9151c21dae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbf5bb7e51d4d2d8594d6d1d3a797a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:25.619530 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-ecc485f4-97ff-454e-8124-e029f5705029 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/de7be542-3f1f-4b34-a68c-4500efe9f8d9" status: 200 len: 1367 microversion: 2.1 time: 0.247536 Apr 08 02:49:25.620127 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 197/397] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:49:25 2022] GET /compute/v2.1/servers/de7be542-3f1f-4b34-a68c-4500efe9f8d9 => generated 1367 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:49:25.777540 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-04786a73-1db9-4324-8ca6-73228490fb4e tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94017d79f24adaa76748899bc7c014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fb44db14d6e4c14b82c05f28e8ee9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:25.785401 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-04786a73-1db9-4324-8ca6-73228490fb4e tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] 10.222.0.48 "GET /compute/v2.1/servers/59d316c0-ed6c-470a-b33f-30b42537143f" status: 200 len: 1318 microversion: 2.1 time: 0.228597 Apr 08 02:49:25.785929 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 201/398] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:49:25 2022] GET /compute/v2.1/servers/59d316c0-ed6c-470a-b33f-30b42537143f => generated 1318 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:49:26.131644 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-d4a8c37a-1b26-41a3-85c6-14348140fc54 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:26.132236 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-d4a8c37a-1b26-41a3-85c6-14348140fc54 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:49:26.139705 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-d4a8c37a-1b26-41a3-85c6-14348140fc54 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:26.140142 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-d4a8c37a-1b26-41a3-85c6-14348140fc54 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:26.140893 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-d4a8c37a-1b26-41a3-85c6-14348140fc54 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:26.141318 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-d4a8c37a-1b26-41a3-85c6-14348140fc54 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:26.342026 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-d4a8c37a-1b26-41a3-85c6-14348140fc54 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:26.355190 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-d4a8c37a-1b26-41a3-85c6-14348140fc54 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:26.361150 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-d4a8c37a-1b26-41a3-85c6-14348140fc54 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:26.362230 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-d4a8c37a-1b26-41a3-85c6-14348140fc54 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1746 microversion: 2.20 time: 0.239558 Apr 08 02:49:26.362762 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 198/399] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:49:26 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1746 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:49:26.643147 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-4de532cb-ef93-4aa1-8295-7f6882e944a2 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:26.643865 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-4de532cb-ef93-4aa1-8295-7f6882e944a2 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: de7be542-3f1f-4b34-a68c-4500efe9f8d9] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:49:26.651024 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-4de532cb-ef93-4aa1-8295-7f6882e944a2 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:26.652161 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-4de532cb-ef93-4aa1-8295-7f6882e944a2 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:26.652931 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-4de532cb-ef93-4aa1-8295-7f6882e944a2 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:26.653358 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-4de532cb-ef93-4aa1-8295-7f6882e944a2 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:26.806901 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-321fb390-83d6-42ed-8bd3-3746b3c7cc09 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:26.807508 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-321fb390-83d6-42ed-8bd3-3746b3c7cc09 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] [instance: 59d316c0-ed6c-470a-b33f-30b42537143f] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:49:26.815497 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-321fb390-83d6-42ed-8bd3-3746b3c7cc09 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:26.815940 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-321fb390-83d6-42ed-8bd3-3746b3c7cc09 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:26.816711 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-321fb390-83d6-42ed-8bd3-3746b3c7cc09 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:26.817142 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-321fb390-83d6-42ed-8bd3-3746b3c7cc09 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:26.848395 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-4de532cb-ef93-4aa1-8295-7f6882e944a2 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68bc45984974d6da1c9151c21dae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbf5bb7e51d4d2d8594d6d1d3a797a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:26.856405 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-4de532cb-ef93-4aa1-8295-7f6882e944a2 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/de7be542-3f1f-4b34-a68c-4500efe9f8d9" status: 200 len: 1367 microversion: 2.1 time: 0.223314 Apr 08 02:49:26.856941 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 202/400] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:49:26 2022] GET /compute/v2.1/servers/de7be542-3f1f-4b34-a68c-4500efe9f8d9 => generated 1367 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:49:27.069039 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-321fb390-83d6-42ed-8bd3-3746b3c7cc09 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94017d79f24adaa76748899bc7c014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fb44db14d6e4c14b82c05f28e8ee9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:27.076994 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-321fb390-83d6-42ed-8bd3-3746b3c7cc09 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] 10.222.0.48 "GET /compute/v2.1/servers/59d316c0-ed6c-470a-b33f-30b42537143f" status: 200 len: 1507 microversion: 2.1 time: 0.279112 Apr 08 02:49:27.077519 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 199/401] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:49:26 2022] GET /compute/v2.1/servers/59d316c0-ed6c-470a-b33f-30b42537143f => generated 1507 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:49:27.098878 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-b4589ad3-9a19-44c3-bc53-533a15a0d09d tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "11fa8932-adda-43ee-a83b-c2a659de15b9", "device": "/dev/sdb"}} {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:49:27.100042 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-b4589ad3-9a19-44c3-bc53-533a15a0d09d tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] [instance: 59d316c0-ed6c-470a-b33f-30b42537143f] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:49:27.108007 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b4589ad3-9a19-44c3-bc53-533a15a0d09d tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:27.108452 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b4589ad3-9a19-44c3-bc53-533a15a0d09d tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:27.109217 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b4589ad3-9a19-44c3-bc53-533a15a0d09d tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:27.109652 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b4589ad3-9a19-44c3-bc53-533a15a0d09d tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:27.387400 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-94e1dbc0-c483-4c36-9056-202f3b1f99bb tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:27.388278 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-94e1dbc0-c483-4c36-9056-202f3b1f99bb tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:49:27.410037 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-94e1dbc0-c483-4c36-9056-202f3b1f99bb tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:27.410472 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-94e1dbc0-c483-4c36-9056-202f3b1f99bb tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:27.411422 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-94e1dbc0-c483-4c36-9056-202f3b1f99bb tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:27.411972 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-94e1dbc0-c483-4c36-9056-202f3b1f99bb tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:27.602910 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-b4589ad3-9a19-44c3-bc53-533a15a0d09d tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] 10.222.0.48 "POST /compute/v2.1/servers/59d316c0-ed6c-470a-b33f-30b42537143f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.513061 Apr 08 02:49:27.609096 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 203/402] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Apr 8 02:49:27 2022] POST /compute/v2.1/servers/59d316c0-ed6c-470a-b33f-30b42537143f/os-volume_attachments => generated 194 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:49:27.620757 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [req-e0a5ee6d-4794-424e-94c1-fdfe718c2e63 req-fb12bfd9-047e-49d4-87c4-72f18561d6ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e44bc1d2-0741-4081-9165-b0aca9008eaf", "name": "network-vif-plugged", "status": "completed", "tag": "e1447a33-5dc8-44ca-8978-a2f1cdaaab34"}]} {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:49:27.627251 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:49:27.627251 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: warnings.warn(msg) Apr 08 02:49:27.636763 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-e0a5ee6d-4794-424e-94c1-fdfe718c2e63 req-fb12bfd9-047e-49d4-87c4-72f18561d6ba service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:27.637789 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-e0a5ee6d-4794-424e-94c1-fdfe718c2e63 req-fb12bfd9-047e-49d4-87c4-72f18561d6ba service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:27.639545 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-94e1dbc0-c483-4c36-9056-202f3b1f99bb tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:27.655217 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-94e1dbc0-c483-4c36-9056-202f3b1f99bb tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:27.657811 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.compute.server_external_events [req-e0a5ee6d-4794-424e-94c1-fdfe718c2e63 req-fb12bfd9-047e-49d4-87c4-72f18561d6ba service nova] Creating event network-vif-plugged:e1447a33-5dc8-44ca-8978-a2f1cdaaab34 for instance e44bc1d2-0741-4081-9165-b0aca9008eaf on hv-cinder-83705 Apr 08 02:49:27.661848 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-94e1dbc0-c483-4c36-9056-202f3b1f99bb tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:27.663225 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-94e1dbc0-c483-4c36-9056-202f3b1f99bb tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1746 microversion: 2.20 time: 0.285697 Apr 08 02:49:27.663396 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [req-e0a5ee6d-4794-424e-94c1-fdfe718c2e63 req-fb12bfd9-047e-49d4-87c4-72f18561d6ba service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052762 Apr 08 02:49:27.663885 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 200/403] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:49:27 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1746 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 02:49:27.664030 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 204/404] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:49:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:49:27.877695 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-c2d57ba3-a815-43db-9136-4e46288f73a1 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:27.878290 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-c2d57ba3-a815-43db-9136-4e46288f73a1 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: de7be542-3f1f-4b34-a68c-4500efe9f8d9] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:49:27.886285 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-c2d57ba3-a815-43db-9136-4e46288f73a1 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:27.886764 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-c2d57ba3-a815-43db-9136-4e46288f73a1 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:27.887526 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-c2d57ba3-a815-43db-9136-4e46288f73a1 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:27.888222 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-c2d57ba3-a815-43db-9136-4e46288f73a1 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:28.086397 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-c2d57ba3-a815-43db-9136-4e46288f73a1 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68bc45984974d6da1c9151c21dae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbf5bb7e51d4d2d8594d6d1d3a797a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:28.095019 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-c2d57ba3-a815-43db-9136-4e46288f73a1 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/de7be542-3f1f-4b34-a68c-4500efe9f8d9" status: 200 len: 1367 microversion: 2.1 time: 0.226267 Apr 08 02:49:28.095553 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 201/405] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:49:27 2022] GET /compute/v2.1/servers/de7be542-3f1f-4b34-a68c-4500efe9f8d9 => generated 1367 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:49:28.689043 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-a252986e-c1d2-43ca-8100-d16596cf8b00 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:28.690381 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-a252986e-c1d2-43ca-8100-d16596cf8b00 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:49:28.698376 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-a252986e-c1d2-43ca-8100-d16596cf8b00 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:28.698980 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-a252986e-c1d2-43ca-8100-d16596cf8b00 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:28.699763 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-a252986e-c1d2-43ca-8100-d16596cf8b00 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:28.700189 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-a252986e-c1d2-43ca-8100-d16596cf8b00 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:28.911527 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-a252986e-c1d2-43ca-8100-d16596cf8b00 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:28.928015 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-a252986e-c1d2-43ca-8100-d16596cf8b00 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:28.935352 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-a252986e-c1d2-43ca-8100-d16596cf8b00 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:28.936459 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-a252986e-c1d2-43ca-8100-d16596cf8b00 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1746 microversion: 2.20 time: 0.258686 Apr 08 02:49:28.936983 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 205/406] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:49:28 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1746 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:49:29.116805 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-4fc46226-567a-4ef5-bcd5-e531f6428f08 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:29.117386 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-4fc46226-567a-4ef5-bcd5-e531f6428f08 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: de7be542-3f1f-4b34-a68c-4500efe9f8d9] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:49:29.125096 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-4fc46226-567a-4ef5-bcd5-e531f6428f08 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:29.125536 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-4fc46226-567a-4ef5-bcd5-e531f6428f08 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:29.126305 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-4fc46226-567a-4ef5-bcd5-e531f6428f08 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:29.126757 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-4fc46226-567a-4ef5-bcd5-e531f6428f08 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:29.341431 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-4fc46226-567a-4ef5-bcd5-e531f6428f08 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68bc45984974d6da1c9151c21dae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbf5bb7e51d4d2d8594d6d1d3a797a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:29.349732 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-4fc46226-567a-4ef5-bcd5-e531f6428f08 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/de7be542-3f1f-4b34-a68c-4500efe9f8d9" status: 200 len: 1367 microversion: 2.1 time: 0.241896 Apr 08 02:49:29.350268 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 202/407] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:49:29 2022] GET /compute/v2.1/servers/de7be542-3f1f-4b34-a68c-4500efe9f8d9 => generated 1367 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:49:29.959899 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-015d6f42-f86c-43f7-887e-9dcb90b41128 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:29.960501 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-015d6f42-f86c-43f7-887e-9dcb90b41128 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:49:29.967975 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-015d6f42-f86c-43f7-887e-9dcb90b41128 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:29.968415 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-015d6f42-f86c-43f7-887e-9dcb90b41128 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:29.969195 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-015d6f42-f86c-43f7-887e-9dcb90b41128 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:29.969604 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-015d6f42-f86c-43f7-887e-9dcb90b41128 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:30.169168 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-015d6f42-f86c-43f7-887e-9dcb90b41128 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:30.182096 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-015d6f42-f86c-43f7-887e-9dcb90b41128 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:30.191057 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-015d6f42-f86c-43f7-887e-9dcb90b41128 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:30.192147 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-015d6f42-f86c-43f7-887e-9dcb90b41128 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1746 microversion: 2.20 time: 0.241285 Apr 08 02:49:30.192665 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 206/408] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:49:29 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1746 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 02:49:30.372200 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-637d9bf9-40aa-4315-b55d-803372ebbde9 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:30.372721 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-637d9bf9-40aa-4315-b55d-803372ebbde9 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: de7be542-3f1f-4b34-a68c-4500efe9f8d9] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:49:30.379890 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-637d9bf9-40aa-4315-b55d-803372ebbde9 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:30.380330 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-637d9bf9-40aa-4315-b55d-803372ebbde9 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:30.381088 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-637d9bf9-40aa-4315-b55d-803372ebbde9 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:30.381521 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-637d9bf9-40aa-4315-b55d-803372ebbde9 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:30.590607 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-637d9bf9-40aa-4315-b55d-803372ebbde9 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68bc45984974d6da1c9151c21dae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbf5bb7e51d4d2d8594d6d1d3a797a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:30.598593 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-637d9bf9-40aa-4315-b55d-803372ebbde9 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/de7be542-3f1f-4b34-a68c-4500efe9f8d9" status: 200 len: 1367 microversion: 2.1 time: 0.236115 Apr 08 02:49:30.599158 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 203/409] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:49:30 2022] GET /compute/v2.1/servers/de7be542-3f1f-4b34-a68c-4500efe9f8d9 => generated 1367 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:49:31.215318 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-6556a3fd-1127-4720-84cd-1d7587992ca5 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:31.215848 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-6556a3fd-1127-4720-84cd-1d7587992ca5 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:49:31.224038 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-6556a3fd-1127-4720-84cd-1d7587992ca5 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:31.224477 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-6556a3fd-1127-4720-84cd-1d7587992ca5 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:31.225229 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-6556a3fd-1127-4720-84cd-1d7587992ca5 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:31.225653 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-6556a3fd-1127-4720-84cd-1d7587992ca5 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:31.430437 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-6556a3fd-1127-4720-84cd-1d7587992ca5 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:31.443925 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-6556a3fd-1127-4720-84cd-1d7587992ca5 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:31.450958 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-6556a3fd-1127-4720-84cd-1d7587992ca5 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:31.452044 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-6556a3fd-1127-4720-84cd-1d7587992ca5 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1746 microversion: 2.20 time: 0.245780 Apr 08 02:49:31.452559 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 207/410] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:49:31 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1746 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:49:31.622607 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-8260a9f9-8dd2-42b7-8ec5-6562da3bf7c6 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:31.623342 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-8260a9f9-8dd2-42b7-8ec5-6562da3bf7c6 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: de7be542-3f1f-4b34-a68c-4500efe9f8d9] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:49:31.630567 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-8260a9f9-8dd2-42b7-8ec5-6562da3bf7c6 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:31.631042 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-8260a9f9-8dd2-42b7-8ec5-6562da3bf7c6 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:31.631822 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-8260a9f9-8dd2-42b7-8ec5-6562da3bf7c6 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:31.632254 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-8260a9f9-8dd2-42b7-8ec5-6562da3bf7c6 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:31.853444 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-8260a9f9-8dd2-42b7-8ec5-6562da3bf7c6 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68bc45984974d6da1c9151c21dae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbf5bb7e51d4d2d8594d6d1d3a797a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:31.862228 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-8260a9f9-8dd2-42b7-8ec5-6562da3bf7c6 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/de7be542-3f1f-4b34-a68c-4500efe9f8d9" status: 200 len: 1367 microversion: 2.1 time: 0.250035 Apr 08 02:49:31.862785 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 204/411] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:49:31 2022] GET /compute/v2.1/servers/de7be542-3f1f-4b34-a68c-4500efe9f8d9 => generated 1367 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:49:32.475181 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-283775f9-4cca-49f9-ad11-64d71c25eaf8 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:32.475726 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-283775f9-4cca-49f9-ad11-64d71c25eaf8 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:49:32.485503 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-283775f9-4cca-49f9-ad11-64d71c25eaf8 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:32.485982 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-283775f9-4cca-49f9-ad11-64d71c25eaf8 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:32.486777 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-283775f9-4cca-49f9-ad11-64d71c25eaf8 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:32.487204 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-283775f9-4cca-49f9-ad11-64d71c25eaf8 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:32.717254 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-283775f9-4cca-49f9-ad11-64d71c25eaf8 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:32.732412 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-283775f9-4cca-49f9-ad11-64d71c25eaf8 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:32.739113 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-283775f9-4cca-49f9-ad11-64d71c25eaf8 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:32.740228 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-283775f9-4cca-49f9-ad11-64d71c25eaf8 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1741 microversion: 2.20 time: 0.274426 Apr 08 02:49:32.751115 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 208/412] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:49:32 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1741 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:49:32.886378 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-98ddb58e-d6e2-43b9-99ed-a4ce00cdf483 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:32.886927 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-98ddb58e-d6e2-43b9-99ed-a4ce00cdf483 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: de7be542-3f1f-4b34-a68c-4500efe9f8d9] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:49:32.896832 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-98ddb58e-d6e2-43b9-99ed-a4ce00cdf483 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:32.897291 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-98ddb58e-d6e2-43b9-99ed-a4ce00cdf483 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:32.898071 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-98ddb58e-d6e2-43b9-99ed-a4ce00cdf483 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:32.898500 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-98ddb58e-d6e2-43b9-99ed-a4ce00cdf483 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:33.413129 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-98ddb58e-d6e2-43b9-99ed-a4ce00cdf483 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68bc45984974d6da1c9151c21dae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbf5bb7e51d4d2d8594d6d1d3a797a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:33.423425 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-98ddb58e-d6e2-43b9-99ed-a4ce00cdf483 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/de7be542-3f1f-4b34-a68c-4500efe9f8d9" status: 200 len: 1367 microversion: 2.1 time: 0.547718 Apr 08 02:49:33.434862 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 205/413] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:49:32 2022] GET /compute/v2.1/servers/de7be542-3f1f-4b34-a68c-4500efe9f8d9 => generated 1367 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:49:33.618253 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [req-64f69c10-65ec-48e4-ac2b-b74e61d35955 req-0a02946c-d4ac-4d23-af18-df2d77086771 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de7be542-3f1f-4b34-a68c-4500efe9f8d9", "name": "network-vif-plugged", "status": "completed", "tag": "47e2a2ae-5384-4804-b0be-7c736b7e4b92"}]} {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:49:33.629188 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:49:33.629188 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: warnings.warn(msg) Apr 08 02:49:33.642764 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-64f69c10-65ec-48e4-ac2b-b74e61d35955 req-0a02946c-d4ac-4d23-af18-df2d77086771 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:33.643196 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-64f69c10-65ec-48e4-ac2b-b74e61d35955 req-0a02946c-d4ac-4d23-af18-df2d77086771 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:33.667860 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.compute.server_external_events [req-64f69c10-65ec-48e4-ac2b-b74e61d35955 req-0a02946c-d4ac-4d23-af18-df2d77086771 service nova] Creating event network-vif-plugged:47e2a2ae-5384-4804-b0be-7c736b7e4b92 for instance de7be542-3f1f-4b34-a68c-4500efe9f8d9 on hv-cinder-83705 Apr 08 02:49:33.674737 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [req-64f69c10-65ec-48e4-ac2b-b74e61d35955 req-0a02946c-d4ac-4d23-af18-df2d77086771 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065585 Apr 08 02:49:33.676002 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 209/414] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:49:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:49:33.764468 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-b8b1ff31-ec8e-4664-8ef1-91aef29b1628 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:33.765339 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-b8b1ff31-ec8e-4664-8ef1-91aef29b1628 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:49:33.773641 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b8b1ff31-ec8e-4664-8ef1-91aef29b1628 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:33.774123 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b8b1ff31-ec8e-4664-8ef1-91aef29b1628 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:33.774907 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b8b1ff31-ec8e-4664-8ef1-91aef29b1628 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:33.775656 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b8b1ff31-ec8e-4664-8ef1-91aef29b1628 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:34.047595 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-b8b1ff31-ec8e-4664-8ef1-91aef29b1628 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:34.066735 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-b8b1ff31-ec8e-4664-8ef1-91aef29b1628 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:34.073725 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-b8b1ff31-ec8e-4664-8ef1-91aef29b1628 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:34.075732 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-b8b1ff31-ec8e-4664-8ef1-91aef29b1628 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1741 microversion: 2.20 time: 0.320978 Apr 08 02:49:34.076761 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 206/415] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:49:33 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1741 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:49:34.449210 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-cd0b043f-d41b-43d2-8a8a-d1eae8de10f0 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:34.450217 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-cd0b043f-d41b-43d2-8a8a-d1eae8de10f0 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: de7be542-3f1f-4b34-a68c-4500efe9f8d9] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:49:34.458584 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-cd0b043f-d41b-43d2-8a8a-d1eae8de10f0 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:34.459273 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-cd0b043f-d41b-43d2-8a8a-d1eae8de10f0 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:34.460227 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-cd0b043f-d41b-43d2-8a8a-d1eae8de10f0 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:34.460999 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-cd0b043f-d41b-43d2-8a8a-d1eae8de10f0 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:34.848824 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-cd0b043f-d41b-43d2-8a8a-d1eae8de10f0 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68bc45984974d6da1c9151c21dae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbf5bb7e51d4d2d8594d6d1d3a797a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:34.864188 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-cd0b043f-d41b-43d2-8a8a-d1eae8de10f0 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/de7be542-3f1f-4b34-a68c-4500efe9f8d9" status: 200 len: 1367 microversion: 2.1 time: 0.425954 Apr 08 02:49:34.865303 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 210/416] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:49:34 2022] GET /compute/v2.1/servers/de7be542-3f1f-4b34-a68c-4500efe9f8d9 => generated 1367 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:49:35.100143 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-0c33f5b6-3b82-44fc-a384-c698b6fa1ff9 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:35.100773 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-0c33f5b6-3b82-44fc-a384-c698b6fa1ff9 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:49:35.109082 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-0c33f5b6-3b82-44fc-a384-c698b6fa1ff9 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:35.109653 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-0c33f5b6-3b82-44fc-a384-c698b6fa1ff9 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:35.110618 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-0c33f5b6-3b82-44fc-a384-c698b6fa1ff9 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:35.111075 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-0c33f5b6-3b82-44fc-a384-c698b6fa1ff9 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:35.387330 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-0c33f5b6-3b82-44fc-a384-c698b6fa1ff9 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:35.407482 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-0c33f5b6-3b82-44fc-a384-c698b6fa1ff9 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:35.416152 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-0c33f5b6-3b82-44fc-a384-c698b6fa1ff9 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:35.419054 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-0c33f5b6-3b82-44fc-a384-c698b6fa1ff9 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1741 microversion: 2.20 time: 0.327890 Apr 08 02:49:35.419588 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 207/417] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:49:35 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1741 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:49:35.888392 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-69fcdd33-b783-4909-8cab-31b445775558 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:35.888971 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-69fcdd33-b783-4909-8cab-31b445775558 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: de7be542-3f1f-4b34-a68c-4500efe9f8d9] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:49:35.897081 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-69fcdd33-b783-4909-8cab-31b445775558 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:35.897529 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-69fcdd33-b783-4909-8cab-31b445775558 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:35.898300 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-69fcdd33-b783-4909-8cab-31b445775558 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:35.898935 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-69fcdd33-b783-4909-8cab-31b445775558 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:36.162291 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-69fcdd33-b783-4909-8cab-31b445775558 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68bc45984974d6da1c9151c21dae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbf5bb7e51d4d2d8594d6d1d3a797a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:36.174848 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-69fcdd33-b783-4909-8cab-31b445775558 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/de7be542-3f1f-4b34-a68c-4500efe9f8d9" status: 200 len: 1367 microversion: 2.1 time: 0.297202 Apr 08 02:49:36.179813 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 211/418] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:49:35 2022] GET /compute/v2.1/servers/de7be542-3f1f-4b34-a68c-4500efe9f8d9 => generated 1367 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:49:36.443885 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-75b2796e-fc93-4d6e-a87e-7ce0456e760e tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:36.445459 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-75b2796e-fc93-4d6e-a87e-7ce0456e760e tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:49:36.458576 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-75b2796e-fc93-4d6e-a87e-7ce0456e760e tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:36.459429 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-75b2796e-fc93-4d6e-a87e-7ce0456e760e tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:36.460418 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-75b2796e-fc93-4d6e-a87e-7ce0456e760e tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:36.460867 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-75b2796e-fc93-4d6e-a87e-7ce0456e760e tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:36.736964 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-75b2796e-fc93-4d6e-a87e-7ce0456e760e tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:36.762601 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-75b2796e-fc93-4d6e-a87e-7ce0456e760e tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:36.773279 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-75b2796e-fc93-4d6e-a87e-7ce0456e760e tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:36.775400 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-75b2796e-fc93-4d6e-a87e-7ce0456e760e tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1741 microversion: 2.20 time: 0.341170 Apr 08 02:49:36.789099 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 208/419] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:49:36 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1741 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:49:37.211968 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-21719612-7e8d-4062-82e2-3e7e696b6dd3 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:37.214935 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-21719612-7e8d-4062-82e2-3e7e696b6dd3 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: de7be542-3f1f-4b34-a68c-4500efe9f8d9] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:49:37.223772 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-21719612-7e8d-4062-82e2-3e7e696b6dd3 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:37.224429 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-21719612-7e8d-4062-82e2-3e7e696b6dd3 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:37.225204 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-21719612-7e8d-4062-82e2-3e7e696b6dd3 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:37.225628 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-21719612-7e8d-4062-82e2-3e7e696b6dd3 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:37.456842 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-21719612-7e8d-4062-82e2-3e7e696b6dd3 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68bc45984974d6da1c9151c21dae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbf5bb7e51d4d2d8594d6d1d3a797a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:37.466925 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-21719612-7e8d-4062-82e2-3e7e696b6dd3 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/de7be542-3f1f-4b34-a68c-4500efe9f8d9" status: 200 len: 1556 microversion: 2.1 time: 0.275268 Apr 08 02:49:37.477996 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 212/420] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:49:37 2022] GET /compute/v2.1/servers/de7be542-3f1f-4b34-a68c-4500efe9f8d9 => generated 1556 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:49:37.493082 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-c4924414-a152-46d5-a5e6-2b2cac7dc75f tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:37.494099 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-c4924414-a152-46d5-a5e6-2b2cac7dc75f tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: de7be542-3f1f-4b34-a68c-4500efe9f8d9] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:49:37.503618 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-c4924414-a152-46d5-a5e6-2b2cac7dc75f tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:37.504055 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-c4924414-a152-46d5-a5e6-2b2cac7dc75f tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:37.505002 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-c4924414-a152-46d5-a5e6-2b2cac7dc75f tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:37.505740 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-c4924414-a152-46d5-a5e6-2b2cac7dc75f tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:37.711155 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-c4924414-a152-46d5-a5e6-2b2cac7dc75f tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/de7be542-3f1f-4b34-a68c-4500efe9f8d9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.230708 Apr 08 02:49:37.711852 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 209/421] 10.222.0.48 () {58 vars in 1274 bytes} [Fri Apr 8 02:49:37 2022] GET /compute/v2.1/servers/de7be542-3f1f-4b34-a68c-4500efe9f8d9/os-interface => generated 284 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:49:37.805345 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-d607ae77-b654-470a-a919-587824db5365 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:37.806257 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-d607ae77-b654-470a-a919-587824db5365 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:49:37.818824 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-d607ae77-b654-470a-a919-587824db5365 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:37.819561 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-d607ae77-b654-470a-a919-587824db5365 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:37.821078 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-d607ae77-b654-470a-a919-587824db5365 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:37.821695 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-d607ae77-b654-470a-a919-587824db5365 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:38.387581 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-d607ae77-b654-470a-a919-587824db5365 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:38.404022 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-d607ae77-b654-470a-a919-587824db5365 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:38.410766 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-d607ae77-b654-470a-a919-587824db5365 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:38.412019 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-d607ae77-b654-470a-a919-587824db5365 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1741 microversion: 2.20 time: 0.619829 Apr 08 02:49:38.415642 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 213/422] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:49:37 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1741 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:49:39.439191 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-989558f5-48e2-4391-ac2f-765cd227a7dd tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:39.440674 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-989558f5-48e2-4391-ac2f-765cd227a7dd tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:49:39.451280 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-989558f5-48e2-4391-ac2f-765cd227a7dd tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:39.451842 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-989558f5-48e2-4391-ac2f-765cd227a7dd tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:39.452834 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-989558f5-48e2-4391-ac2f-765cd227a7dd tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:39.453353 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-989558f5-48e2-4391-ac2f-765cd227a7dd tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:39.919219 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-989558f5-48e2-4391-ac2f-765cd227a7dd tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:39.966644 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-989558f5-48e2-4391-ac2f-765cd227a7dd tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:40.003714 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-989558f5-48e2-4391-ac2f-765cd227a7dd tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:40.006630 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-989558f5-48e2-4391-ac2f-765cd227a7dd tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1741 microversion: 2.20 time: 0.578208 Apr 08 02:49:40.017285 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 210/423] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:49:39 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1741 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:49:40.062188 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [req-69f86d63-18bb-4499-85fb-64c867b6c44b req-ddf56377-dfdb-4133-b37c-f5442082b536 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de7be542-3f1f-4b34-a68c-4500efe9f8d9", "tag": "47e2a2ae-5384-4804-b0be-7c736b7e4b92"}]} {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:49:40.071504 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:49:40.071504 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: warnings.warn(msg) Apr 08 02:49:40.086723 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-69f86d63-18bb-4499-85fb-64c867b6c44b req-ddf56377-dfdb-4133-b37c-f5442082b536 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:40.087411 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-69f86d63-18bb-4499-85fb-64c867b6c44b req-ddf56377-dfdb-4133-b37c-f5442082b536 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:40.106980 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.compute.server_external_events [req-69f86d63-18bb-4499-85fb-64c867b6c44b req-ddf56377-dfdb-4133-b37c-f5442082b536 service nova] Creating event network-changed:47e2a2ae-5384-4804-b0be-7c736b7e4b92 for instance de7be542-3f1f-4b34-a68c-4500efe9f8d9 on hv-cinder-83705 Apr 08 02:49:40.112089 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [req-69f86d63-18bb-4499-85fb-64c867b6c44b req-ddf56377-dfdb-4133-b37c-f5442082b536 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059765 Apr 08 02:49:40.112671 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 214/424] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:49:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:49:41.031147 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-688105ec-583e-4ee2-a8fc-5dd985f9d55e tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:41.032396 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-688105ec-583e-4ee2-a8fc-5dd985f9d55e tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:49:41.040250 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-688105ec-583e-4ee2-a8fc-5dd985f9d55e tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:41.040970 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-688105ec-583e-4ee2-a8fc-5dd985f9d55e tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:41.042627 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-688105ec-583e-4ee2-a8fc-5dd985f9d55e tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:41.043419 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-688105ec-583e-4ee2-a8fc-5dd985f9d55e tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:41.298316 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-688105ec-583e-4ee2-a8fc-5dd985f9d55e tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:41.314100 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-688105ec-583e-4ee2-a8fc-5dd985f9d55e tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:41.321812 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-688105ec-583e-4ee2-a8fc-5dd985f9d55e tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:41.323066 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-688105ec-583e-4ee2-a8fc-5dd985f9d55e tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1741 microversion: 2.20 time: 0.301884 Apr 08 02:49:41.323900 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 211/425] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:49:41 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1741 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:49:42.348382 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-a3a0ec68-361d-4c85-98c6-9e9c75866b44 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:42.349160 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-a3a0ec68-361d-4c85-98c6-9e9c75866b44 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:49:42.358161 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-a3a0ec68-361d-4c85-98c6-9e9c75866b44 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:42.358161 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-a3a0ec68-361d-4c85-98c6-9e9c75866b44 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:42.358821 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-a3a0ec68-361d-4c85-98c6-9e9c75866b44 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:42.359261 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-a3a0ec68-361d-4c85-98c6-9e9c75866b44 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:42.631171 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-a3a0ec68-361d-4c85-98c6-9e9c75866b44 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:42.649122 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-a3a0ec68-361d-4c85-98c6-9e9c75866b44 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:42.655633 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-a3a0ec68-361d-4c85-98c6-9e9c75866b44 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:42.656900 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-a3a0ec68-361d-4c85-98c6-9e9c75866b44 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1741 microversion: 2.20 time: 0.319602 Apr 08 02:49:42.658712 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 215/426] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:49:42 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1741 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 02:49:43.024735 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-b2e1a5aa-8dc3-4fb2-bec7-ad3aeed3efaa tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:43.025379 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-b2e1a5aa-8dc3-4fb2-bec7-ad3aeed3efaa tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 19ff8616-8e62-40fe-87e7-f976433b9288] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:49:43.046845 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b2e1a5aa-8dc3-4fb2-bec7-ad3aeed3efaa tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:43.047570 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b2e1a5aa-8dc3-4fb2-bec7-ad3aeed3efaa tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:43.048527 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b2e1a5aa-8dc3-4fb2-bec7-ad3aeed3efaa tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:43.049126 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b2e1a5aa-8dc3-4fb2-bec7-ad3aeed3efaa tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:43.124272 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-b2e1a5aa-8dc3-4fb2-bec7-ad3aeed3efaa tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288/ips" status: 200 len: 144 microversion: 2.1 time: 0.108373 Apr 08 02:49:43.125096 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 212/427] 10.222.0.48 () {58 vars in 1247 bytes} [Fri Apr 8 02:49:43 2022] GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288/ips => generated 144 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:49:43.680327 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-4d2cf0ef-3053-49a2-b721-b5540c2ec00f tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:43.680935 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-4d2cf0ef-3053-49a2-b721-b5540c2ec00f tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:49:43.686397 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 08 02:49:43.686569 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: Fri Apr 8 02:49:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf (ip 10.222.0.48) !!! Apr 08 02:49:43.701368 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-4d2cf0ef-3053-49a2-b721-b5540c2ec00f tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:43.701806 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-4d2cf0ef-3053-49a2-b721-b5540c2ec00f tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:43.702577 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-4d2cf0ef-3053-49a2-b721-b5540c2ec00f tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:43.703030 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-4d2cf0ef-3053-49a2-b721-b5540c2ec00f tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:43.915203 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-4d2cf0ef-3053-49a2-b721-b5540c2ec00f tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:43.929035 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-4d2cf0ef-3053-49a2-b721-b5540c2ec00f tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:43.936144 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-4d2cf0ef-3053-49a2-b721-b5540c2ec00f tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:43.937251 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-4d2cf0ef-3053-49a2-b721-b5540c2ec00f tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1741 microversion: 2.20 time: 0.265949 Apr 08 02:49:43.937774 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 216/428] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:49:43 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1741 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:49:44.961884 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-68f71e04-e742-49e1-a2f4-1eadd6c2abf4 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:44.962810 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-68f71e04-e742-49e1-a2f4-1eadd6c2abf4 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:49:44.972194 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-68f71e04-e742-49e1-a2f4-1eadd6c2abf4 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:44.972895 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-68f71e04-e742-49e1-a2f4-1eadd6c2abf4 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:44.974259 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-68f71e04-e742-49e1-a2f4-1eadd6c2abf4 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:44.974692 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-68f71e04-e742-49e1-a2f4-1eadd6c2abf4 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:45.200505 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-68f71e04-e742-49e1-a2f4-1eadd6c2abf4 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:45.215132 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-68f71e04-e742-49e1-a2f4-1eadd6c2abf4 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:45.221289 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-68f71e04-e742-49e1-a2f4-1eadd6c2abf4 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:45.222614 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-68f71e04-e742-49e1-a2f4-1eadd6c2abf4 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1741 microversion: 2.20 time: 0.271137 Apr 08 02:49:45.223154 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 213/429] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:49:44 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1741 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:49:46.247276 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-01be33dd-9297-40f7-a9a1-5b21138680fa tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:46.247869 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-01be33dd-9297-40f7-a9a1-5b21138680fa tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:49:46.256195 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-01be33dd-9297-40f7-a9a1-5b21138680fa tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:46.256683 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-01be33dd-9297-40f7-a9a1-5b21138680fa tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:46.257601 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-01be33dd-9297-40f7-a9a1-5b21138680fa tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:46.258045 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-01be33dd-9297-40f7-a9a1-5b21138680fa tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:46.470844 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-01be33dd-9297-40f7-a9a1-5b21138680fa tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:46.485847 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-01be33dd-9297-40f7-a9a1-5b21138680fa tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:46.492137 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-01be33dd-9297-40f7-a9a1-5b21138680fa tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:46.493271 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-01be33dd-9297-40f7-a9a1-5b21138680fa tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1741 microversion: 2.20 time: 0.255556 Apr 08 02:49:46.493798 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 217/430] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:49:46 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1741 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:49:47.519265 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-8bdc6456-e5dc-4988-b440-52e7135dc68f tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:47.519830 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-8bdc6456-e5dc-4988-b440-52e7135dc68f tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:49:47.527626 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-8bdc6456-e5dc-4988-b440-52e7135dc68f tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:47.528064 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-8bdc6456-e5dc-4988-b440-52e7135dc68f tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:47.528834 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-8bdc6456-e5dc-4988-b440-52e7135dc68f tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:47.529258 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-8bdc6456-e5dc-4988-b440-52e7135dc68f tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:47.743352 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-8bdc6456-e5dc-4988-b440-52e7135dc68f tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:47.758495 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-8bdc6456-e5dc-4988-b440-52e7135dc68f tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:47.766222 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-8bdc6456-e5dc-4988-b440-52e7135dc68f tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:47.767606 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-8bdc6456-e5dc-4988-b440-52e7135dc68f tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1741 microversion: 2.20 time: 0.258684 Apr 08 02:49:47.768721 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 214/431] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:49:47 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1741 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:49:49.067900 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-372334ea-694a-4aaa-827f-3afab7918db8 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:49.070175 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-372334ea-694a-4aaa-827f-3afab7918db8 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:49:49.080891 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-372334ea-694a-4aaa-827f-3afab7918db8 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:49.081957 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-372334ea-694a-4aaa-827f-3afab7918db8 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:49.082643 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-372334ea-694a-4aaa-827f-3afab7918db8 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:49.083544 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-372334ea-694a-4aaa-827f-3afab7918db8 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:49.329733 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-372334ea-694a-4aaa-827f-3afab7918db8 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:49.345831 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-372334ea-694a-4aaa-827f-3afab7918db8 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:49.352963 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-372334ea-694a-4aaa-827f-3afab7918db8 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:49.354523 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-372334ea-694a-4aaa-827f-3afab7918db8 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1741 microversion: 2.20 time: 0.573073 Apr 08 02:49:49.355777 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 218/432] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:49:48 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1741 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:49:50.378536 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-a8762e62-6c47-4b36-9769-4e12207b192e tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:50.381030 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-a8762e62-6c47-4b36-9769-4e12207b192e tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:49:50.394265 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-a8762e62-6c47-4b36-9769-4e12207b192e tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:50.395018 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-a8762e62-6c47-4b36-9769-4e12207b192e tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:50.396037 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-a8762e62-6c47-4b36-9769-4e12207b192e tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:50.396623 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-a8762e62-6c47-4b36-9769-4e12207b192e tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:50.636937 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-a8762e62-6c47-4b36-9769-4e12207b192e tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:50.650675 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-a8762e62-6c47-4b36-9769-4e12207b192e tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:50.656928 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-a8762e62-6c47-4b36-9769-4e12207b192e tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:50.658019 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-a8762e62-6c47-4b36-9769-4e12207b192e tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1723 microversion: 2.20 time: 0.289106 Apr 08 02:49:50.658698 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 215/433] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:49:50 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1723 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:49:50.702362 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-1bcab8b6-314a-4034-9e04-8f2414ad1c50 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ce8c1190-1af4-4aca-be3d-2e09f424ffb4"}} {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:49:50.703501 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-1bcab8b6-314a-4034-9e04-8f2414ad1c50 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 19ff8616-8e62-40fe-87e7-f976433b9288] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:49:50.710559 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-1bcab8b6-314a-4034-9e04-8f2414ad1c50 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:50.711046 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-1bcab8b6-314a-4034-9e04-8f2414ad1c50 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:50.711819 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-1bcab8b6-314a-4034-9e04-8f2414ad1c50 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:50.712244 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-1bcab8b6-314a-4034-9e04-8f2414ad1c50 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:51.105387 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-1bcab8b6-314a-4034-9e04-8f2414ad1c50 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "POST /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.411717 Apr 08 02:49:51.110587 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 219/434] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Apr 8 02:49:50 2022] POST /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288/os-volume_attachments => generated 194 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:49:51.683249 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-ce1f4d6d-cfe6-46cb-b70c-0a60e4db9d3e tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:51.683856 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-ce1f4d6d-cfe6-46cb-b70c-0a60e4db9d3e tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:49:51.692282 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ce1f4d6d-cfe6-46cb-b70c-0a60e4db9d3e tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:51.692789 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ce1f4d6d-cfe6-46cb-b70c-0a60e4db9d3e tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:51.693579 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ce1f4d6d-cfe6-46cb-b70c-0a60e4db9d3e tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:51.694015 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ce1f4d6d-cfe6-46cb-b70c-0a60e4db9d3e tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:51.843840 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [req-2b6edaeb-a523-47fa-ad4a-dc53b755b5cc req-effe4c11-9b89-427e-a1a4-206b721dd383 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e44bc1d2-0741-4081-9165-b0aca9008eaf", "name": "network-vif-unplugged", "status": "completed", "tag": "e1447a33-5dc8-44ca-8978-a2f1cdaaab34"}]} {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:49:51.852571 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:49:51.852571 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: warnings.warn(msg) Apr 08 02:49:51.866757 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-2b6edaeb-a523-47fa-ad4a-dc53b755b5cc req-effe4c11-9b89-427e-a1a4-206b721dd383 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:51.867583 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-2b6edaeb-a523-47fa-ad4a-dc53b755b5cc req-effe4c11-9b89-427e-a1a4-206b721dd383 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:51.889619 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.compute.server_external_events [req-2b6edaeb-a523-47fa-ad4a-dc53b755b5cc req-effe4c11-9b89-427e-a1a4-206b721dd383 service nova] Creating event network-vif-unplugged:e1447a33-5dc8-44ca-8978-a2f1cdaaab34 for instance e44bc1d2-0741-4081-9165-b0aca9008eaf on hv-cinder-83705 Apr 08 02:49:51.896330 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [req-2b6edaeb-a523-47fa-ad4a-dc53b755b5cc req-effe4c11-9b89-427e-a1a4-206b721dd383 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071576 Apr 08 02:49:51.897443 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 220/435] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:49:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:49:51.970406 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-ce1f4d6d-cfe6-46cb-b70c-0a60e4db9d3e tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:51.988312 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-ce1f4d6d-cfe6-46cb-b70c-0a60e4db9d3e tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:51.995840 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-ce1f4d6d-cfe6-46cb-b70c-0a60e4db9d3e tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:51.996978 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-ce1f4d6d-cfe6-46cb-b70c-0a60e4db9d3e tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1723 microversion: 2.20 time: 0.324080 Apr 08 02:49:51.997824 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 216/436] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:49:51 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1723 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:49:53.026215 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-919c5e86-8e2e-4d78-b0f5-7c4d4eafe100 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:53.027350 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-919c5e86-8e2e-4d78-b0f5-7c4d4eafe100 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:49:53.039099 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-919c5e86-8e2e-4d78-b0f5-7c4d4eafe100 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:53.039883 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-919c5e86-8e2e-4d78-b0f5-7c4d4eafe100 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:53.041204 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-919c5e86-8e2e-4d78-b0f5-7c4d4eafe100 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:53.041636 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-919c5e86-8e2e-4d78-b0f5-7c4d4eafe100 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:53.258953 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-919c5e86-8e2e-4d78-b0f5-7c4d4eafe100 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:53.273344 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-919c5e86-8e2e-4d78-b0f5-7c4d4eafe100 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:53.280553 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-919c5e86-8e2e-4d78-b0f5-7c4d4eafe100 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:53.281699 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-919c5e86-8e2e-4d78-b0f5-7c4d4eafe100 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1726 microversion: 2.20 time: 0.269104 Apr 08 02:49:53.282230 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 221/437] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:49:53 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1726 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:49:53.305985 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-d3750000-6972-4496-a699-7129bccd804c tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "55a712a3-452d-472b-bfc7-ec66a9031da4"}} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:49:53.307263 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-d3750000-6972-4496-a699-7129bccd804c tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:49:53.314932 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-d3750000-6972-4496-a699-7129bccd804c tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:53.315759 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-d3750000-6972-4496-a699-7129bccd804c tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:53.317236 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-d3750000-6972-4496-a699-7129bccd804c tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:53.317822 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-d3750000-6972-4496-a699-7129bccd804c tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:53.543336 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-25fd3ebc-8d55-4514-84d1-10cb686f6797 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:53.543954 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-25fd3ebc-8d55-4514-84d1-10cb686f6797 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] [instance: 59d316c0-ed6c-470a-b33f-30b42537143f] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:49:53.551751 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-25fd3ebc-8d55-4514-84d1-10cb686f6797 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:53.552197 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-25fd3ebc-8d55-4514-84d1-10cb686f6797 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:53.552979 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-25fd3ebc-8d55-4514-84d1-10cb686f6797 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:53.553408 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-25fd3ebc-8d55-4514-84d1-10cb686f6797 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:53.886130 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-25fd3ebc-8d55-4514-84d1-10cb686f6797 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] 10.222.0.48 "DELETE /compute/v2.1/servers/59d316c0-ed6c-470a-b33f-30b42537143f/os-volume_attachments/11fa8932-adda-43ee-a83b-c2a659de15b9" status: 202 len: 0 microversion: 2.1 time: 0.353458 Apr 08 02:49:53.887859 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 222/438] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Apr 8 02:49:53 2022] DELETE /compute/v2.1/servers/59d316c0-ed6c-470a-b33f-30b42537143f/os-volume_attachments/11fa8932-adda-43ee-a83b-c2a659de15b9 => generated 0 bytes in 356 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 08 02:49:53.938258 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-d3750000-6972-4496-a699-7129bccd804c tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "POST /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.641347 Apr 08 02:49:53.939604 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 217/439] 10.222.0.48 () {62 vars in 1363 bytes} [Fri Apr 8 02:49:53 2022] POST /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf/os-volume_attachments => generated 188 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 02:49:54.148624 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-a713d56b-9349-4d80-bf42-8ba07e02af79 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:49:54.149273 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-a713d56b-9349-4d80-bf42-8ba07e02af79 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:49:54.157434 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-a713d56b-9349-4d80-bf42-8ba07e02af79 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:54.157880 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-a713d56b-9349-4d80-bf42-8ba07e02af79 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:54.158651 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-a713d56b-9349-4d80-bf42-8ba07e02af79 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:54.159277 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-a713d56b-9349-4d80-bf42-8ba07e02af79 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:54.716242 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-a713d56b-9349-4d80-bf42-8ba07e02af79 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "POST /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf/action" status: 202 len: 0 microversion: 2.20 time: 0.577454 Apr 08 02:49:54.717476 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 223/440] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Apr 8 02:49:54 2022] POST /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf/action => generated 0 bytes in 580 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 08 02:49:54.738411 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-07173a93-91fc-4ef5-b2f6-89d57675ae16 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:54.739167 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-07173a93-91fc-4ef5-b2f6-89d57675ae16 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:49:54.756165 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-07173a93-91fc-4ef5-b2f6-89d57675ae16 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:54.756529 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-07173a93-91fc-4ef5-b2f6-89d57675ae16 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:54.763426 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-07173a93-91fc-4ef5-b2f6-89d57675ae16 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:54.763877 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-07173a93-91fc-4ef5-b2f6-89d57675ae16 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:55.260299 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-07173a93-91fc-4ef5-b2f6-89d57675ae16 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:55.286371 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-07173a93-91fc-4ef5-b2f6-89d57675ae16 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:55.296179 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-07173a93-91fc-4ef5-b2f6-89d57675ae16 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:55.298597 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-07173a93-91fc-4ef5-b2f6-89d57675ae16 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1752 microversion: 2.20 time: 0.577215 Apr 08 02:49:55.300021 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 218/441] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:49:54 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1752 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:49:56.328143 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-fb4161d8-3106-40ad-b6d6-bfd09d593bc0 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:56.330490 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-fb4161d8-3106-40ad-b6d6-bfd09d593bc0 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:49:56.339578 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-fb4161d8-3106-40ad-b6d6-bfd09d593bc0 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:56.340433 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-fb4161d8-3106-40ad-b6d6-bfd09d593bc0 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:56.341553 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-fb4161d8-3106-40ad-b6d6-bfd09d593bc0 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:56.342132 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-fb4161d8-3106-40ad-b6d6-bfd09d593bc0 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:56.784985 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-fb4161d8-3106-40ad-b6d6-bfd09d593bc0 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:56.803866 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-fb4161d8-3106-40ad-b6d6-bfd09d593bc0 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:56.813319 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-fb4161d8-3106-40ad-b6d6-bfd09d593bc0 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:56.814377 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-fb4161d8-3106-40ad-b6d6-bfd09d593bc0 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1754 microversion: 2.20 time: 0.498967 Apr 08 02:49:56.815246 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 224/442] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:49:56 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1754 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:49:57.842151 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-ed7f192e-b646-4de9-8d53-b8b3c15f97a1 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:57.842931 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-ed7f192e-b646-4de9-8d53-b8b3c15f97a1 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:49:57.862210 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ed7f192e-b646-4de9-8d53-b8b3c15f97a1 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:57.862581 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ed7f192e-b646-4de9-8d53-b8b3c15f97a1 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:57.864618 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ed7f192e-b646-4de9-8d53-b8b3c15f97a1 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:57.865603 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ed7f192e-b646-4de9-8d53-b8b3c15f97a1 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:58.282585 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-ed7f192e-b646-4de9-8d53-b8b3c15f97a1 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:58.309647 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-ed7f192e-b646-4de9-8d53-b8b3c15f97a1 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:58.318516 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-ed7f192e-b646-4de9-8d53-b8b3c15f97a1 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:58.320046 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-ed7f192e-b646-4de9-8d53-b8b3c15f97a1 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1754 microversion: 2.20 time: 0.490655 Apr 08 02:49:58.331746 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 219/443] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:49:57 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1754 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:49:59.194134 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-f405898f-59e3-4af4-8622-c8dc85ebcddd tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:49:59.202575 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-f405898f-59e3-4af4-8622-c8dc85ebcddd tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:59.203332 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-f405898f-59e3-4af4-8622-c8dc85ebcddd tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:59.278461 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-f405898f-59e3-4af4-8622-c8dc85ebcddd tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 19ff8616-8e62-40fe-87e7-f976433b9288] Going to try to stop instance {{(pid=96920) force_stop /opt/stack/nova/nova/compute/api.py:2599}} Apr 08 02:49:59.350653 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-046bc405-908e-499e-8626-5f1410c95d59 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:59.351884 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-046bc405-908e-499e-8626-5f1410c95d59 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:49:59.366533 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-046bc405-908e-499e-8626-5f1410c95d59 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:59.369137 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-046bc405-908e-499e-8626-5f1410c95d59 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:59.370018 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-046bc405-908e-499e-8626-5f1410c95d59 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:59.370465 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-046bc405-908e-499e-8626-5f1410c95d59 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:59.393285 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-f405898f-59e3-4af4-8622-c8dc85ebcddd tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "POST /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288/action" status: 202 len: 0 microversion: 2.1 time: 0.208079 Apr 08 02:49:59.395085 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 225/444] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Apr 8 02:49:59 2022] POST /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288/action => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 02:49:59.412239 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-0ee53f51-ccb3-4942-8824-f8eab3ba66a8 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:59.413818 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-0ee53f51-ccb3-4942-8824-f8eab3ba66a8 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 19ff8616-8e62-40fe-87e7-f976433b9288] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:49:59.426376 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-0ee53f51-ccb3-4942-8824-f8eab3ba66a8 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:59.427887 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-0ee53f51-ccb3-4942-8824-f8eab3ba66a8 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:59.430296 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-0ee53f51-ccb3-4942-8824-f8eab3ba66a8 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:59.430884 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-0ee53f51-ccb3-4942-8824-f8eab3ba66a8 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:59.804676 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-0ee53f51-ccb3-4942-8824-f8eab3ba66a8 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a88a8d7c9e4d0a88308c0e894570be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c31bb4f3ce486591bc142b1da7553e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:59.819409 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-0ee53f51-ccb3-4942-8824-f8eab3ba66a8 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288" status: 200 len: 1721 microversion: 2.1 time: 0.418751 Apr 08 02:49:59.831061 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 226/445] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:49:59 2022] GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288 => generated 1721 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:49:59.881331 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-046bc405-908e-499e-8626-5f1410c95d59 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:59.903546 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-046bc405-908e-499e-8626-5f1410c95d59 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:59.920035 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-046bc405-908e-499e-8626-5f1410c95d59 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:49:59.921262 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-046bc405-908e-499e-8626-5f1410c95d59 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1754 microversion: 2.20 time: 0.584280 Apr 08 02:49:59.922491 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 220/446] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:49:59 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1754 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:49:59.933906 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-eb594c91-076d-4bbb-a911-f5033b77dada tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:49:59.934826 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-eb594c91-076d-4bbb-a911-f5033b77dada tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] [instance: 59d316c0-ed6c-470a-b33f-30b42537143f] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:49:59.947494 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-eb594c91-076d-4bbb-a911-f5033b77dada tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:59.948822 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-eb594c91-076d-4bbb-a911-f5033b77dada tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:49:59.950173 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-eb594c91-076d-4bbb-a911-f5033b77dada tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:49:59.950801 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-eb594c91-076d-4bbb-a911-f5033b77dada tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:00.058820 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-eb594c91-076d-4bbb-a911-f5033b77dada tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] [instance: 59d316c0-ed6c-470a-b33f-30b42537143f] Going to try to terminate instance {{(pid=96919) delete /opt/stack/nova/nova/compute/api.py:2559}} Apr 08 02:50:00.209703 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-eb594c91-076d-4bbb-a911-f5033b77dada tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] 10.222.0.48 "DELETE /compute/v2.1/servers/59d316c0-ed6c-470a-b33f-30b42537143f" status: 204 len: 0 microversion: 2.1 time: 0.285274 Apr 08 02:50:00.210958 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 221/447] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Apr 8 02:49:59 2022] DELETE /compute/v2.1/servers/59d316c0-ed6c-470a-b33f-30b42537143f => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 08 02:50:00.216574 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-c36d075b-60c6-489e-a2b4-2ea2d05ceba6 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Action: 'create', calling method: .version_select at 0x7f7d4e5839d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-386305352"}} {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:50:00.226504 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-4a9627d9-d4dd-4ab7-8640-a7ca8d3eb325 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:00.227310 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-4a9627d9-d4dd-4ab7-8640-a7ca8d3eb325 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] [instance: 59d316c0-ed6c-470a-b33f-30b42537143f] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:00.235644 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-4a9627d9-d4dd-4ab7-8640-a7ca8d3eb325 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:00.236175 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-4a9627d9-d4dd-4ab7-8640-a7ca8d3eb325 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:00.237023 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-4a9627d9-d4dd-4ab7-8640-a7ca8d3eb325 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:00.237520 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-4a9627d9-d4dd-4ab7-8640-a7ca8d3eb325 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:00.263676 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.quota [None req-c36d075b-60c6-489e-a2b4-2ea2d05ceba6 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Getting quotas for project 89f311117084470f8e8d16c47ad1d2ae. Resources: {'key_pairs'} {{(pid=96920) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:50:00.269775 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.quota [None req-c36d075b-60c6-489e-a2b4-2ea2d05ceba6 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Getting quotas for user a86a950d41cc44fb9f10b600b20b0ae6 and project 89f311117084470f8e8d16c47ad1d2ae. Resources: {'key_pairs'} {{(pid=96920) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:50:00.485817 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-4a9627d9-d4dd-4ab7-8640-a7ca8d3eb325 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94017d79f24adaa76748899bc7c014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fb44db14d6e4c14b82c05f28e8ee9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:00.495289 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-4a9627d9-d4dd-4ab7-8640-a7ca8d3eb325 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] 10.222.0.48 "GET /compute/v2.1/servers/59d316c0-ed6c-470a-b33f-30b42537143f" status: 200 len: 1513 microversion: 2.1 time: 0.279234 Apr 08 02:50:00.496029 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 222/448] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:00 2022] GET /compute/v2.1/servers/59d316c0-ed6c-470a-b33f-30b42537143f => generated 1513 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:50:00.772130 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.quota [None req-c36d075b-60c6-489e-a2b4-2ea2d05ceba6 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Getting quotas for project 89f311117084470f8e8d16c47ad1d2ae. Resources: {'key_pairs'} {{(pid=96920) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:50:00.776491 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.quota [None req-c36d075b-60c6-489e-a2b4-2ea2d05ceba6 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Getting quotas for user a86a950d41cc44fb9f10b600b20b0ae6 and project 89f311117084470f8e8d16c47ad1d2ae. Resources: {'key_pairs'} {{(pid=96920) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:50:00.789363 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-c36d075b-60c6-489e-a2b4-2ea2d05ceba6 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 2311 microversion: 2.1 time: 0.956943 Apr 08 02:50:00.789939 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 227/449] 10.222.0.48 () {60 vars in 1157 bytes} [Fri Apr 8 02:49:59 2022] POST /compute/v2.1/os-keypairs => generated 2311 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:50:00.843471 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-89d45a6e-38f8-4b64-b420-75aaf0db8534 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:00.844350 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-89d45a6e-38f8-4b64-b420-75aaf0db8534 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 19ff8616-8e62-40fe-87e7-f976433b9288] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:00.851520 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-89d45a6e-38f8-4b64-b420-75aaf0db8534 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:00.852029 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-89d45a6e-38f8-4b64-b420-75aaf0db8534 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:00.853408 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-89d45a6e-38f8-4b64-b420-75aaf0db8534 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:00.854172 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-89d45a6e-38f8-4b64-b420-75aaf0db8534 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:00.945555 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-feb686c1-c4ed-4a1f-96f6-836db6f836e4 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:00.946431 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-feb686c1-c4ed-4a1f-96f6-836db6f836e4 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:00.954770 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-feb686c1-c4ed-4a1f-96f6-836db6f836e4 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:00.955391 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-feb686c1-c4ed-4a1f-96f6-836db6f836e4 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:00.956306 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-feb686c1-c4ed-4a1f-96f6-836db6f836e4 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:00.956877 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-feb686c1-c4ed-4a1f-96f6-836db6f836e4 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:01.284667 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-89d45a6e-38f8-4b64-b420-75aaf0db8534 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a88a8d7c9e4d0a88308c0e894570be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c31bb4f3ce486591bc142b1da7553e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:01.295285 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-89d45a6e-38f8-4b64-b420-75aaf0db8534 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288" status: 200 len: 1721 microversion: 2.1 time: 0.461674 Apr 08 02:50:01.297096 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 223/450] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:00 2022] GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288 => generated 1721 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:50:01.327451 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-feb686c1-c4ed-4a1f-96f6-836db6f836e4 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:01.351326 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-feb686c1-c4ed-4a1f-96f6-836db6f836e4 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:01.363730 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-feb686c1-c4ed-4a1f-96f6-836db6f836e4 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:01.365372 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-feb686c1-c4ed-4a1f-96f6-836db6f836e4 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1754 microversion: 2.20 time: 0.428812 Apr 08 02:50:01.365951 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 228/451] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:50:00 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1754 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 02:50:01.518084 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-b64dcda6-06e4-4487-80ab-24ad37d7a896 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:01.519268 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-b64dcda6-06e4-4487-80ab-24ad37d7a896 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] [instance: 59d316c0-ed6c-470a-b33f-30b42537143f] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:01.529313 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b64dcda6-06e4-4487-80ab-24ad37d7a896 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:01.529875 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b64dcda6-06e4-4487-80ab-24ad37d7a896 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:01.531192 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b64dcda6-06e4-4487-80ab-24ad37d7a896 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:01.532182 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b64dcda6-06e4-4487-80ab-24ad37d7a896 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:01.778486 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-b64dcda6-06e4-4487-80ab-24ad37d7a896 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94017d79f24adaa76748899bc7c014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fb44db14d6e4c14b82c05f28e8ee9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:01.791385 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-b64dcda6-06e4-4487-80ab-24ad37d7a896 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] 10.222.0.48 "GET /compute/v2.1/servers/59d316c0-ed6c-470a-b33f-30b42537143f" status: 200 len: 1513 microversion: 2.1 time: 0.283224 Apr 08 02:50:01.792162 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 224/452] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:01 2022] GET /compute/v2.1/servers/59d316c0-ed6c-470a-b33f-30b42537143f => generated 1513 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:50:02.320627 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-fe316ad9-5be9-40bb-bf03-015c1531caf7 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:02.322415 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-fe316ad9-5be9-40bb-bf03-015c1531caf7 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 19ff8616-8e62-40fe-87e7-f976433b9288] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:02.331215 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-fe316ad9-5be9-40bb-bf03-015c1531caf7 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:02.331687 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-fe316ad9-5be9-40bb-bf03-015c1531caf7 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:02.332363 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-fe316ad9-5be9-40bb-bf03-015c1531caf7 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:02.333014 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-fe316ad9-5be9-40bb-bf03-015c1531caf7 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:02.389340 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-5d32fd61-0667-43e4-85d1-236d6789139a tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:02.389938 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-5d32fd61-0667-43e4-85d1-236d6789139a tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:02.401055 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-5d32fd61-0667-43e4-85d1-236d6789139a tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:02.409439 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-5d32fd61-0667-43e4-85d1-236d6789139a tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:02.412332 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-5d32fd61-0667-43e4-85d1-236d6789139a tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:02.413425 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-5d32fd61-0667-43e4-85d1-236d6789139a tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:02.725064 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-fe316ad9-5be9-40bb-bf03-015c1531caf7 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a88a8d7c9e4d0a88308c0e894570be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c31bb4f3ce486591bc142b1da7553e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:02.747224 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-fe316ad9-5be9-40bb-bf03-015c1531caf7 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288" status: 200 len: 1721 microversion: 2.1 time: 0.437601 Apr 08 02:50:02.748250 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 229/453] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:02 2022] GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288 => generated 1721 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:50:02.815111 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-83f568ae-9585-4aff-a335-fbcc266caa4f tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:02.815970 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-83f568ae-9585-4aff-a335-fbcc266caa4f tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] [instance: 59d316c0-ed6c-470a-b33f-30b42537143f] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:02.824382 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-83f568ae-9585-4aff-a335-fbcc266caa4f tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:02.825110 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-83f568ae-9585-4aff-a335-fbcc266caa4f tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:02.826060 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-83f568ae-9585-4aff-a335-fbcc266caa4f tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:02.827225 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-83f568ae-9585-4aff-a335-fbcc266caa4f tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:02.951347 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-5d32fd61-0667-43e4-85d1-236d6789139a tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:02.979471 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-5d32fd61-0667-43e4-85d1-236d6789139a tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:02.988609 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-5d32fd61-0667-43e4-85d1-236d6789139a tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:02.990032 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-5d32fd61-0667-43e4-85d1-236d6789139a tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1810 microversion: 2.20 time: 0.610215 Apr 08 02:50:02.990848 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 225/454] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:50:02 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1810 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 02:50:03.211715 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-83f568ae-9585-4aff-a335-fbcc266caa4f tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94017d79f24adaa76748899bc7c014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fb44db14d6e4c14b82c05f28e8ee9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:03.221591 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-83f568ae-9585-4aff-a335-fbcc266caa4f tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] 10.222.0.48 "GET /compute/v2.1/servers/59d316c0-ed6c-470a-b33f-30b42537143f" status: 200 len: 1513 microversion: 2.1 time: 0.416839 Apr 08 02:50:03.222562 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 230/455] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:02 2022] GET /compute/v2.1/servers/59d316c0-ed6c-470a-b33f-30b42537143f => generated 1513 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:50:03.771322 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-d88fc430-ba39-4cf1-9599-18ad8bbb59ba tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:03.772039 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-d88fc430-ba39-4cf1-9599-18ad8bbb59ba tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 19ff8616-8e62-40fe-87e7-f976433b9288] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:03.781586 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-d88fc430-ba39-4cf1-9599-18ad8bbb59ba tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:03.782027 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-d88fc430-ba39-4cf1-9599-18ad8bbb59ba tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:03.782837 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-d88fc430-ba39-4cf1-9599-18ad8bbb59ba tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:03.783261 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-d88fc430-ba39-4cf1-9599-18ad8bbb59ba tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:04.029201 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-037242a4-f7ca-4791-b736-c9fc34fcfb6f tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:04.030511 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-037242a4-f7ca-4791-b736-c9fc34fcfb6f tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:04.041770 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-037242a4-f7ca-4791-b736-c9fc34fcfb6f tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:04.043892 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-037242a4-f7ca-4791-b736-c9fc34fcfb6f tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:04.047278 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-037242a4-f7ca-4791-b736-c9fc34fcfb6f tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:04.047995 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-037242a4-f7ca-4791-b736-c9fc34fcfb6f tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:04.083061 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-d88fc430-ba39-4cf1-9599-18ad8bbb59ba tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a88a8d7c9e4d0a88308c0e894570be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c31bb4f3ce486591bc142b1da7553e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:04.100829 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-d88fc430-ba39-4cf1-9599-18ad8bbb59ba tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288" status: 200 len: 1721 microversion: 2.1 time: 0.339433 Apr 08 02:50:04.106155 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 226/456] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:03 2022] GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288 => generated 1721 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:50:04.256517 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-217f3a8a-45bf-41b8-ab0b-a35262cad670 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:04.269290 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-217f3a8a-45bf-41b8-ab0b-a35262cad670 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] [instance: 59d316c0-ed6c-470a-b33f-30b42537143f] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:04.284748 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-217f3a8a-45bf-41b8-ab0b-a35262cad670 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:04.285200 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-217f3a8a-45bf-41b8-ab0b-a35262cad670 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:04.285984 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-217f3a8a-45bf-41b8-ab0b-a35262cad670 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:04.290754 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-037242a4-f7ca-4791-b736-c9fc34fcfb6f tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:04.294882 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-217f3a8a-45bf-41b8-ab0b-a35262cad670 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:04.308537 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-037242a4-f7ca-4791-b736-c9fc34fcfb6f tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:04.320677 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-037242a4-f7ca-4791-b736-c9fc34fcfb6f tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:04.322789 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-037242a4-f7ca-4791-b736-c9fc34fcfb6f tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1810 microversion: 2.20 time: 0.316804 Apr 08 02:50:04.323343 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 231/457] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:50:04 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1810 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 02:50:04.671028 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-217f3a8a-45bf-41b8-ab0b-a35262cad670 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94017d79f24adaa76748899bc7c014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fb44db14d6e4c14b82c05f28e8ee9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:04.679003 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-217f3a8a-45bf-41b8-ab0b-a35262cad670 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] 10.222.0.48 "GET /compute/v2.1/servers/59d316c0-ed6c-470a-b33f-30b42537143f" status: 200 len: 1513 microversion: 2.1 time: 0.437429 Apr 08 02:50:04.679520 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 227/458] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:04 2022] GET /compute/v2.1/servers/59d316c0-ed6c-470a-b33f-30b42537143f => generated 1513 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:50:05.127874 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-7a1b3f66-93dc-4a36-8578-d060c2c8195a tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:05.128494 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-7a1b3f66-93dc-4a36-8578-d060c2c8195a tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 19ff8616-8e62-40fe-87e7-f976433b9288] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:05.135942 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-7a1b3f66-93dc-4a36-8578-d060c2c8195a tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:05.136382 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-7a1b3f66-93dc-4a36-8578-d060c2c8195a tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:05.137255 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-7a1b3f66-93dc-4a36-8578-d060c2c8195a tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:05.137978 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-7a1b3f66-93dc-4a36-8578-d060c2c8195a tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:05.347105 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-d84a607a-3d21-40d6-bb3c-c38f33850996 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:05.349045 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-d84a607a-3d21-40d6-bb3c-c38f33850996 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:05.357662 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-d84a607a-3d21-40d6-bb3c-c38f33850996 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:05.358412 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-d84a607a-3d21-40d6-bb3c-c38f33850996 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:05.359412 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-d84a607a-3d21-40d6-bb3c-c38f33850996 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:05.360033 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-d84a607a-3d21-40d6-bb3c-c38f33850996 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:05.377756 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-7a1b3f66-93dc-4a36-8578-d060c2c8195a tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a88a8d7c9e4d0a88308c0e894570be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c31bb4f3ce486591bc142b1da7553e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:05.389554 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-7a1b3f66-93dc-4a36-8578-d060c2c8195a tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288" status: 200 len: 1721 microversion: 2.1 time: 0.269563 Apr 08 02:50:05.389554 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 232/459] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:05 2022] GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288 => generated 1721 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:50:05.589302 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-d84a607a-3d21-40d6-bb3c-c38f33850996 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:05.604304 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-d84a607a-3d21-40d6-bb3c-c38f33850996 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:05.610447 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-d84a607a-3d21-40d6-bb3c-c38f33850996 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:05.611603 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-d84a607a-3d21-40d6-bb3c-c38f33850996 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1810 microversion: 2.20 time: 0.274110 Apr 08 02:50:05.612126 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 228/460] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:50:05 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1810 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:50:05.703018 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-d82bb106-bf56-4139-8089-0d10f8041cae tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:05.703621 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-d82bb106-bf56-4139-8089-0d10f8041cae tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] [instance: 59d316c0-ed6c-470a-b33f-30b42537143f] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:05.710895 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-d82bb106-bf56-4139-8089-0d10f8041cae tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:05.711335 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-d82bb106-bf56-4139-8089-0d10f8041cae tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:05.712143 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-d82bb106-bf56-4139-8089-0d10f8041cae tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:05.712651 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-d82bb106-bf56-4139-8089-0d10f8041cae tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:05.759944 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [req-955d7f9c-762d-44c2-aaaf-fe9d76eb0896 req-f1fe2d52-4661-40e6-be40-0b5fcc3d0f5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59d316c0-ed6c-470a-b33f-30b42537143f", "name": "network-vif-unplugged", "status": "completed", "tag": "ee406698-29e8-4d95-b213-93379362182c"}]} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:50:05.766539 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:50:05.766539 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: warnings.warn(msg) Apr 08 02:50:05.798704 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-955d7f9c-762d-44c2-aaaf-fe9d76eb0896 req-f1fe2d52-4661-40e6-be40-0b5fcc3d0f5e service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:05.799144 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-955d7f9c-762d-44c2-aaaf-fe9d76eb0896 req-f1fe2d52-4661-40e6-be40-0b5fcc3d0f5e service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:05.816396 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.compute.server_external_events [req-955d7f9c-762d-44c2-aaaf-fe9d76eb0896 req-f1fe2d52-4661-40e6-be40-0b5fcc3d0f5e service nova] Creating event network-vif-unplugged:ee406698-29e8-4d95-b213-93379362182c for instance 59d316c0-ed6c-470a-b33f-30b42537143f on hv-cinder-83705 Apr 08 02:50:05.821294 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [req-955d7f9c-762d-44c2-aaaf-fe9d76eb0896 req-f1fe2d52-4661-40e6-be40-0b5fcc3d0f5e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071084 Apr 08 02:50:05.822827 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 229/461] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:50:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:50:05.987296 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-d82bb106-bf56-4139-8089-0d10f8041cae tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94017d79f24adaa76748899bc7c014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fb44db14d6e4c14b82c05f28e8ee9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:06.000046 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-d82bb106-bf56-4139-8089-0d10f8041cae tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] 10.222.0.48 "GET /compute/v2.1/servers/59d316c0-ed6c-470a-b33f-30b42537143f" status: 200 len: 1513 microversion: 2.1 time: 0.303518 Apr 08 02:50:06.006691 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 233/462] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:05 2022] GET /compute/v2.1/servers/59d316c0-ed6c-470a-b33f-30b42537143f => generated 1513 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:50:06.411729 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-421f352e-d01f-4be3-8ed9-47a2197b737a tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:06.412401 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-421f352e-d01f-4be3-8ed9-47a2197b737a tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 19ff8616-8e62-40fe-87e7-f976433b9288] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:06.419732 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-421f352e-d01f-4be3-8ed9-47a2197b737a tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:06.420169 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-421f352e-d01f-4be3-8ed9-47a2197b737a tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:06.420934 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-421f352e-d01f-4be3-8ed9-47a2197b737a tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:06.421364 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-421f352e-d01f-4be3-8ed9-47a2197b737a tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:06.636286 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-627ceca3-b955-451a-a5a7-bc6dfdcc68cc tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:06.636963 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-627ceca3-b955-451a-a5a7-bc6dfdcc68cc tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:06.644733 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-627ceca3-b955-451a-a5a7-bc6dfdcc68cc tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:06.644912 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-627ceca3-b955-451a-a5a7-bc6dfdcc68cc tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:06.645662 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-627ceca3-b955-451a-a5a7-bc6dfdcc68cc tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:06.646090 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-627ceca3-b955-451a-a5a7-bc6dfdcc68cc tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:06.671529 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-421f352e-d01f-4be3-8ed9-47a2197b737a tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a88a8d7c9e4d0a88308c0e894570be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c31bb4f3ce486591bc142b1da7553e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:06.680242 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-421f352e-d01f-4be3-8ed9-47a2197b737a tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288" status: 200 len: 1721 microversion: 2.1 time: 0.277828 Apr 08 02:50:06.681542 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 230/463] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:06 2022] GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288 => generated 1721 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:50:06.880634 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-627ceca3-b955-451a-a5a7-bc6dfdcc68cc tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:06.896269 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-627ceca3-b955-451a-a5a7-bc6dfdcc68cc tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:06.902480 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-627ceca3-b955-451a-a5a7-bc6dfdcc68cc tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:06.903626 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-627ceca3-b955-451a-a5a7-bc6dfdcc68cc tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1810 microversion: 2.20 time: 0.277982 Apr 08 02:50:06.904172 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 234/464] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:50:06 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1810 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:50:07.020183 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-ffd147ab-0330-4a41-8125-5eb75be703cf tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:07.020895 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-ffd147ab-0330-4a41-8125-5eb75be703cf tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] [instance: 59d316c0-ed6c-470a-b33f-30b42537143f] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:07.029063 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ffd147ab-0330-4a41-8125-5eb75be703cf tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:07.029501 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ffd147ab-0330-4a41-8125-5eb75be703cf tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:07.030271 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ffd147ab-0330-4a41-8125-5eb75be703cf tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:07.030719 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ffd147ab-0330-4a41-8125-5eb75be703cf tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:07.257854 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-ffd147ab-0330-4a41-8125-5eb75be703cf tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94017d79f24adaa76748899bc7c014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fb44db14d6e4c14b82c05f28e8ee9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:07.268089 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-ffd147ab-0330-4a41-8125-5eb75be703cf tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] 10.222.0.48 "GET /compute/v2.1/servers/59d316c0-ed6c-470a-b33f-30b42537143f" status: 200 len: 1513 microversion: 2.1 time: 0.258116 Apr 08 02:50:07.268840 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 231/465] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:07 2022] GET /compute/v2.1/servers/59d316c0-ed6c-470a-b33f-30b42537143f => generated 1513 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:50:07.704345 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-8976f235-a6ba-456b-8029-bdf32dde9922 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:07.705022 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-8976f235-a6ba-456b-8029-bdf32dde9922 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 19ff8616-8e62-40fe-87e7-f976433b9288] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:07.712892 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-8976f235-a6ba-456b-8029-bdf32dde9922 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:07.713361 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-8976f235-a6ba-456b-8029-bdf32dde9922 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:07.714142 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-8976f235-a6ba-456b-8029-bdf32dde9922 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:07.714569 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-8976f235-a6ba-456b-8029-bdf32dde9922 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:07.929990 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-1a5a3a1e-92fb-42ad-873a-c651d58255d9 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:07.941491 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-8976f235-a6ba-456b-8029-bdf32dde9922 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a88a8d7c9e4d0a88308c0e894570be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c31bb4f3ce486591bc142b1da7553e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:07.942578 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-1a5a3a1e-92fb-42ad-873a-c651d58255d9 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:07.953438 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-8976f235-a6ba-456b-8029-bdf32dde9922 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288" status: 200 len: 1721 microversion: 2.1 time: 0.256168 Apr 08 02:50:07.953656 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-1a5a3a1e-92fb-42ad-873a-c651d58255d9 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:07.953755 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 235/466] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:07 2022] GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288 => generated 1721 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:50:07.953846 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-1a5a3a1e-92fb-42ad-873a-c651d58255d9 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:07.953846 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-1a5a3a1e-92fb-42ad-873a-c651d58255d9 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:07.953846 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-1a5a3a1e-92fb-42ad-873a-c651d58255d9 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:08.178560 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-1a5a3a1e-92fb-42ad-873a-c651d58255d9 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:08.194132 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-1a5a3a1e-92fb-42ad-873a-c651d58255d9 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:08.201466 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-1a5a3a1e-92fb-42ad-873a-c651d58255d9 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:08.202690 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-1a5a3a1e-92fb-42ad-873a-c651d58255d9 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1810 microversion: 2.20 time: 0.285064 Apr 08 02:50:08.203160 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 232/467] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:50:07 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1810 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 02:50:08.292933 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-6ffd1234-0f31-488b-8bfe-ed7647d39f97 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:08.293680 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-6ffd1234-0f31-488b-8bfe-ed7647d39f97 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] [instance: 59d316c0-ed6c-470a-b33f-30b42537143f] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:08.300954 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-6ffd1234-0f31-488b-8bfe-ed7647d39f97 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:08.301393 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-6ffd1234-0f31-488b-8bfe-ed7647d39f97 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:08.302155 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-6ffd1234-0f31-488b-8bfe-ed7647d39f97 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:08.302591 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-6ffd1234-0f31-488b-8bfe-ed7647d39f97 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:08.521118 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-6ffd1234-0f31-488b-8bfe-ed7647d39f97 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94017d79f24adaa76748899bc7c014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fb44db14d6e4c14b82c05f28e8ee9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:08.541705 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-6ffd1234-0f31-488b-8bfe-ed7647d39f97 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] 10.222.0.48 "GET /compute/v2.1/servers/59d316c0-ed6c-470a-b33f-30b42537143f" status: 200 len: 1513 microversion: 2.1 time: 0.257612 Apr 08 02:50:08.542268 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 236/468] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:08 2022] GET /compute/v2.1/servers/59d316c0-ed6c-470a-b33f-30b42537143f => generated 1513 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:50:08.973693 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-a99237b8-02fd-4243-af86-c586508b5497 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:08.974279 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-a99237b8-02fd-4243-af86-c586508b5497 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 19ff8616-8e62-40fe-87e7-f976433b9288] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:08.982947 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-a99237b8-02fd-4243-af86-c586508b5497 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:08.983382 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-a99237b8-02fd-4243-af86-c586508b5497 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:08.984154 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-a99237b8-02fd-4243-af86-c586508b5497 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:08.984581 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-a99237b8-02fd-4243-af86-c586508b5497 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:09.222876 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-a99237b8-02fd-4243-af86-c586508b5497 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a88a8d7c9e4d0a88308c0e894570be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c31bb4f3ce486591bc142b1da7553e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:09.226294 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-631ce5be-08d0-4eee-ab82-ba91cc27ffa8 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:09.226926 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-631ce5be-08d0-4eee-ab82-ba91cc27ffa8 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:09.231685 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-a99237b8-02fd-4243-af86-c586508b5497 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288" status: 200 len: 1721 microversion: 2.1 time: 0.267078 Apr 08 02:50:09.232300 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 233/469] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:08 2022] GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288 => generated 1721 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:50:09.237669 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-631ce5be-08d0-4eee-ab82-ba91cc27ffa8 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:09.238224 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-631ce5be-08d0-4eee-ab82-ba91cc27ffa8 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:09.239089 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-631ce5be-08d0-4eee-ab82-ba91cc27ffa8 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:09.239576 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-631ce5be-08d0-4eee-ab82-ba91cc27ffa8 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:09.472338 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-631ce5be-08d0-4eee-ab82-ba91cc27ffa8 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:09.490046 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-631ce5be-08d0-4eee-ab82-ba91cc27ffa8 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:09.498249 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-631ce5be-08d0-4eee-ab82-ba91cc27ffa8 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:09.499661 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-631ce5be-08d0-4eee-ab82-ba91cc27ffa8 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1810 microversion: 2.20 time: 0.282474 Apr 08 02:50:09.500302 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 237/470] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:50:09 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1810 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 02:50:09.573565 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-c6fa64c9-43f2-4789-9389-7a4a4e790764 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:09.574190 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-c6fa64c9-43f2-4789-9389-7a4a4e790764 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] [instance: 59d316c0-ed6c-470a-b33f-30b42537143f] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:09.581475 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-c6fa64c9-43f2-4789-9389-7a4a4e790764 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:09.581930 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-c6fa64c9-43f2-4789-9389-7a4a4e790764 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:09.582765 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-c6fa64c9-43f2-4789-9389-7a4a4e790764 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:09.583204 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-c6fa64c9-43f2-4789-9389-7a4a4e790764 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:09.842347 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-c6fa64c9-43f2-4789-9389-7a4a4e790764 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94017d79f24adaa76748899bc7c014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fb44db14d6e4c14b82c05f28e8ee9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:09.850937 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-c6fa64c9-43f2-4789-9389-7a4a4e790764 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] 10.222.0.48 "GET /compute/v2.1/servers/59d316c0-ed6c-470a-b33f-30b42537143f" status: 200 len: 1513 microversion: 2.1 time: 0.292348 Apr 08 02:50:09.851465 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 234/471] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:09 2022] GET /compute/v2.1/servers/59d316c0-ed6c-470a-b33f-30b42537143f => generated 1513 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:50:10.253928 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-689613d5-689b-44df-8b6a-284415c66ef8 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:10.254573 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-689613d5-689b-44df-8b6a-284415c66ef8 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 19ff8616-8e62-40fe-87e7-f976433b9288] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:10.262823 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-689613d5-689b-44df-8b6a-284415c66ef8 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:10.263249 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-689613d5-689b-44df-8b6a-284415c66ef8 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:10.264277 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-689613d5-689b-44df-8b6a-284415c66ef8 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:10.264841 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-689613d5-689b-44df-8b6a-284415c66ef8 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:10.527617 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-8357e43a-aa1c-4459-94c9-779fce6da52a tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:10.527617 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-8357e43a-aa1c-4459-94c9-779fce6da52a tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:10.534231 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-8357e43a-aa1c-4459-94c9-779fce6da52a tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:10.534715 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-8357e43a-aa1c-4459-94c9-779fce6da52a tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:10.535478 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-8357e43a-aa1c-4459-94c9-779fce6da52a tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:10.535871 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-689613d5-689b-44df-8b6a-284415c66ef8 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a88a8d7c9e4d0a88308c0e894570be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c31bb4f3ce486591bc142b1da7553e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:10.536026 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-8357e43a-aa1c-4459-94c9-779fce6da52a tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:10.557650 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-689613d5-689b-44df-8b6a-284415c66ef8 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288" status: 200 len: 1721 microversion: 2.1 time: 0.312531 Apr 08 02:50:10.558563 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 238/472] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:10 2022] GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288 => generated 1721 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:50:10.793640 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-8357e43a-aa1c-4459-94c9-779fce6da52a tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:10.809341 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-8357e43a-aa1c-4459-94c9-779fce6da52a tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:10.816057 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-8357e43a-aa1c-4459-94c9-779fce6da52a tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:10.820025 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-8357e43a-aa1c-4459-94c9-779fce6da52a tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1810 microversion: 2.20 time: 0.302363 Apr 08 02:50:10.831298 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 235/473] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:50:10 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1810 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:50:10.874012 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-58a84cd6-f938-4619-b5b1-731934da18a3 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:10.874630 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-58a84cd6-f938-4619-b5b1-731934da18a3 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] [instance: 59d316c0-ed6c-470a-b33f-30b42537143f] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:10.884234 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-58a84cd6-f938-4619-b5b1-731934da18a3 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:10.885450 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-58a84cd6-f938-4619-b5b1-731934da18a3 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:10.887103 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-58a84cd6-f938-4619-b5b1-731934da18a3 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:10.887835 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-58a84cd6-f938-4619-b5b1-731934da18a3 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:11.178239 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-58a84cd6-f938-4619-b5b1-731934da18a3 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94017d79f24adaa76748899bc7c014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fb44db14d6e4c14b82c05f28e8ee9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:11.187894 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-58a84cd6-f938-4619-b5b1-731934da18a3 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] 10.222.0.48 "GET /compute/v2.1/servers/59d316c0-ed6c-470a-b33f-30b42537143f" status: 200 len: 1513 microversion: 2.1 time: 0.322900 Apr 08 02:50:11.198393 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 239/474] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:10 2022] GET /compute/v2.1/servers/59d316c0-ed6c-470a-b33f-30b42537143f => generated 1513 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:50:11.588903 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-b1cc6ad4-2fd5-43c8-97e7-60dc44de09b8 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:11.590165 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-b1cc6ad4-2fd5-43c8-97e7-60dc44de09b8 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 19ff8616-8e62-40fe-87e7-f976433b9288] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:11.597835 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b1cc6ad4-2fd5-43c8-97e7-60dc44de09b8 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:11.598553 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b1cc6ad4-2fd5-43c8-97e7-60dc44de09b8 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:11.603711 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b1cc6ad4-2fd5-43c8-97e7-60dc44de09b8 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:11.604659 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b1cc6ad4-2fd5-43c8-97e7-60dc44de09b8 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:11.832570 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-b1cc6ad4-2fd5-43c8-97e7-60dc44de09b8 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a88a8d7c9e4d0a88308c0e894570be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c31bb4f3ce486591bc142b1da7553e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:11.842924 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-b1cc6ad4-2fd5-43c8-97e7-60dc44de09b8 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288" status: 200 len: 1721 microversion: 2.1 time: 0.271645 Apr 08 02:50:11.844961 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 236/475] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:11 2022] GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288 => generated 1721 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:50:11.848987 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-3a6bcbfe-4655-46c1-9575-72506e42cd11 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:11.849587 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-3a6bcbfe-4655-46c1-9575-72506e42cd11 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:11.858933 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-3a6bcbfe-4655-46c1-9575-72506e42cd11 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:11.861870 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-3a6bcbfe-4655-46c1-9575-72506e42cd11 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:11.861870 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-3a6bcbfe-4655-46c1-9575-72506e42cd11 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:11.861870 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-3a6bcbfe-4655-46c1-9575-72506e42cd11 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:12.113908 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-3a6bcbfe-4655-46c1-9575-72506e42cd11 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:12.127775 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-3a6bcbfe-4655-46c1-9575-72506e42cd11 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:12.134781 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-3a6bcbfe-4655-46c1-9575-72506e42cd11 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:12.135523 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-3a6bcbfe-4655-46c1-9575-72506e42cd11 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1810 microversion: 2.20 time: 0.295676 Apr 08 02:50:12.136063 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 240/476] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:50:11 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1810 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 02:50:12.211218 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-db66c999-f176-482f-8e1a-0f661323f3db tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:12.212499 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-db66c999-f176-482f-8e1a-0f661323f3db tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] [instance: 59d316c0-ed6c-470a-b33f-30b42537143f] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:12.219829 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-db66c999-f176-482f-8e1a-0f661323f3db tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:12.220268 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-db66c999-f176-482f-8e1a-0f661323f3db tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:12.221036 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-db66c999-f176-482f-8e1a-0f661323f3db tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:12.221462 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-db66c999-f176-482f-8e1a-0f661323f3db tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:12.466468 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-db66c999-f176-482f-8e1a-0f661323f3db tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94017d79f24adaa76748899bc7c014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fb44db14d6e4c14b82c05f28e8ee9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:12.474694 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-db66c999-f176-482f-8e1a-0f661323f3db tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] 10.222.0.48 "GET /compute/v2.1/servers/59d316c0-ed6c-470a-b33f-30b42537143f" status: 200 len: 1513 microversion: 2.1 time: 0.272861 Apr 08 02:50:12.475268 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 237/477] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:12 2022] GET /compute/v2.1/servers/59d316c0-ed6c-470a-b33f-30b42537143f => generated 1513 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:50:12.866689 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-50478b21-0680-4e76-8bfb-989347b7992b tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:12.867595 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-50478b21-0680-4e76-8bfb-989347b7992b tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 19ff8616-8e62-40fe-87e7-f976433b9288] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:12.878312 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-50478b21-0680-4e76-8bfb-989347b7992b tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:12.878923 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-50478b21-0680-4e76-8bfb-989347b7992b tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:12.879812 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-50478b21-0680-4e76-8bfb-989347b7992b tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:12.880494 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-50478b21-0680-4e76-8bfb-989347b7992b tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:13.147584 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-50478b21-0680-4e76-8bfb-989347b7992b tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a88a8d7c9e4d0a88308c0e894570be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c31bb4f3ce486591bc142b1da7553e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:13.162342 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-6478fc40-69bc-4612-9d34-c27409de79dd tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:13.162987 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-6478fc40-69bc-4612-9d34-c27409de79dd tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:13.175909 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-50478b21-0680-4e76-8bfb-989347b7992b tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288" status: 200 len: 1721 microversion: 2.1 time: 0.319017 Apr 08 02:50:13.181653 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 241/478] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:12 2022] GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288 => generated 1721 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:50:13.181935 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-6478fc40-69bc-4612-9d34-c27409de79dd tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:13.181935 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-6478fc40-69bc-4612-9d34-c27409de79dd tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:13.182393 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-6478fc40-69bc-4612-9d34-c27409de79dd tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:13.182997 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-6478fc40-69bc-4612-9d34-c27409de79dd tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:13.398148 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-6478fc40-69bc-4612-9d34-c27409de79dd tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:13.412303 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-6478fc40-69bc-4612-9d34-c27409de79dd tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:13.418888 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-6478fc40-69bc-4612-9d34-c27409de79dd tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:13.419962 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-6478fc40-69bc-4612-9d34-c27409de79dd tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1810 microversion: 2.20 time: 0.267785 Apr 08 02:50:13.420478 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 238/479] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:50:13 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1810 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 02:50:13.497346 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-4a04c9e1-dd73-4d4e-84a1-4216dcca0310 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:13.498156 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-4a04c9e1-dd73-4d4e-84a1-4216dcca0310 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] [instance: 59d316c0-ed6c-470a-b33f-30b42537143f] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:13.505396 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-4a04c9e1-dd73-4d4e-84a1-4216dcca0310 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:13.505830 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-4a04c9e1-dd73-4d4e-84a1-4216dcca0310 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:13.506577 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-4a04c9e1-dd73-4d4e-84a1-4216dcca0310 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:13.507025 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-4a04c9e1-dd73-4d4e-84a1-4216dcca0310 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:13.707775 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-4a04c9e1-dd73-4d4e-84a1-4216dcca0310 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94017d79f24adaa76748899bc7c014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fb44db14d6e4c14b82c05f28e8ee9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:13.716649 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-4a04c9e1-dd73-4d4e-84a1-4216dcca0310 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] 10.222.0.48 "GET /compute/v2.1/servers/59d316c0-ed6c-470a-b33f-30b42537143f" status: 200 len: 1513 microversion: 2.1 time: 0.228292 Apr 08 02:50:13.717174 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 242/480] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:13 2022] GET /compute/v2.1/servers/59d316c0-ed6c-470a-b33f-30b42537143f => generated 1513 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:50:14.198846 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-9878a1a2-859b-430c-8909-1a7cc1f360dc tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:14.199360 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-9878a1a2-859b-430c-8909-1a7cc1f360dc tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 19ff8616-8e62-40fe-87e7-f976433b9288] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:14.206398 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-9878a1a2-859b-430c-8909-1a7cc1f360dc tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:14.206868 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-9878a1a2-859b-430c-8909-1a7cc1f360dc tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:14.207617 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-9878a1a2-859b-430c-8909-1a7cc1f360dc tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:14.208041 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-9878a1a2-859b-430c-8909-1a7cc1f360dc tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:14.404412 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-9878a1a2-859b-430c-8909-1a7cc1f360dc tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a88a8d7c9e4d0a88308c0e894570be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c31bb4f3ce486591bc142b1da7553e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:14.412757 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-9878a1a2-859b-430c-8909-1a7cc1f360dc tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288" status: 200 len: 1721 microversion: 2.1 time: 0.223419 Apr 08 02:50:14.413273 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 239/481] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:14 2022] GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288 => generated 1721 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:50:14.442762 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-97756eb9-6c85-4442-90fa-e5b400f8e904 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:14.443345 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-97756eb9-6c85-4442-90fa-e5b400f8e904 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:14.451470 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-97756eb9-6c85-4442-90fa-e5b400f8e904 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:14.451843 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-97756eb9-6c85-4442-90fa-e5b400f8e904 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:14.452598 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-97756eb9-6c85-4442-90fa-e5b400f8e904 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:14.453017 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-97756eb9-6c85-4442-90fa-e5b400f8e904 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:14.654753 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-97756eb9-6c85-4442-90fa-e5b400f8e904 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:14.668812 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-97756eb9-6c85-4442-90fa-e5b400f8e904 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:14.674785 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-97756eb9-6c85-4442-90fa-e5b400f8e904 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:14.675860 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-97756eb9-6c85-4442-90fa-e5b400f8e904 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1810 microversion: 2.20 time: 0.242254 Apr 08 02:50:14.676372 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 243/482] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:50:14 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1810 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:50:14.738952 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-71ce16ba-a6e9-4f13-94dc-278f0df39b27 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:14.739471 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-71ce16ba-a6e9-4f13-94dc-278f0df39b27 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] [instance: 59d316c0-ed6c-470a-b33f-30b42537143f] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:14.746569 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-71ce16ba-a6e9-4f13-94dc-278f0df39b27 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:14.747035 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-71ce16ba-a6e9-4f13-94dc-278f0df39b27 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:14.747791 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-71ce16ba-a6e9-4f13-94dc-278f0df39b27 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:14.748214 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-71ce16ba-a6e9-4f13-94dc-278f0df39b27 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:14.943751 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-71ce16ba-a6e9-4f13-94dc-278f0df39b27 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94017d79f24adaa76748899bc7c014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fb44db14d6e4c14b82c05f28e8ee9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:14.952055 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-71ce16ba-a6e9-4f13-94dc-278f0df39b27 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] 10.222.0.48 "GET /compute/v2.1/servers/59d316c0-ed6c-470a-b33f-30b42537143f" status: 200 len: 1513 microversion: 2.1 time: 0.222074 Apr 08 02:50:14.952579 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 240/483] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:14 2022] GET /compute/v2.1/servers/59d316c0-ed6c-470a-b33f-30b42537143f => generated 1513 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:50:15.435002 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-ea72b9a2-9fcd-4605-8b71-06bbd3ae305f tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:15.435679 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-ea72b9a2-9fcd-4605-8b71-06bbd3ae305f tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 19ff8616-8e62-40fe-87e7-f976433b9288] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:15.443191 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-ea72b9a2-9fcd-4605-8b71-06bbd3ae305f tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:15.443831 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-ea72b9a2-9fcd-4605-8b71-06bbd3ae305f tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:15.444378 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-ea72b9a2-9fcd-4605-8b71-06bbd3ae305f tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:15.444801 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-ea72b9a2-9fcd-4605-8b71-06bbd3ae305f tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:15.651848 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-ea72b9a2-9fcd-4605-8b71-06bbd3ae305f tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a88a8d7c9e4d0a88308c0e894570be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c31bb4f3ce486591bc142b1da7553e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:15.660310 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-ea72b9a2-9fcd-4605-8b71-06bbd3ae305f tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288" status: 200 len: 1698 microversion: 2.1 time: 0.234834 Apr 08 02:50:15.661060 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 244/484] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:15 2022] GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288 => generated 1698 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:50:15.682493 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-e73e5a40-58eb-4046-82bc-537fceb462b3 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:50:15.689944 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-e73e5a40-58eb-4046-82bc-537fceb462b3 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:15.690382 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-e73e5a40-58eb-4046-82bc-537fceb462b3 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:15.752224 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-e73e5a40-58eb-4046-82bc-537fceb462b3 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 19ff8616-8e62-40fe-87e7-f976433b9288] Going to try to start instance {{(pid=96919) start /opt/stack/nova/nova/compute/api.py:2622}} Apr 08 02:50:15.774964 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [req-ed10dc41-3069-45bb-9fe8-b94fb90a1b76 req-ca7d7f2e-29e4-4b27-8195-fb7961bc7e3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59d316c0-ed6c-470a-b33f-30b42537143f", "name": "network-vif-deleted", "tag": "ee406698-29e8-4d95-b213-93379362182c"}]} {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:50:15.781118 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:50:15.781118 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: warnings.warn(msg) Apr 08 02:50:15.789578 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-ed10dc41-3069-45bb-9fe8-b94fb90a1b76 req-ca7d7f2e-29e4-4b27-8195-fb7961bc7e3b service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:15.791218 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-ed10dc41-3069-45bb-9fe8-b94fb90a1b76 req-ca7d7f2e-29e4-4b27-8195-fb7961bc7e3b service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:15.809027 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.compute.server_external_events [req-ed10dc41-3069-45bb-9fe8-b94fb90a1b76 req-ca7d7f2e-29e4-4b27-8195-fb7961bc7e3b service nova] Creating event network-vif-deleted:ee406698-29e8-4d95-b213-93379362182c for instance 59d316c0-ed6c-470a-b33f-30b42537143f on hv-cinder-83705 Apr 08 02:50:15.813688 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [req-ed10dc41-3069-45bb-9fe8-b94fb90a1b76 req-ca7d7f2e-29e4-4b27-8195-fb7961bc7e3b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136156 Apr 08 02:50:15.814248 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 245/485] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:50:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 02:50:15.827103 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-603b3cb3-4e32-4e18-8217-e29ac7869029 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:15.827819 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-603b3cb3-4e32-4e18-8217-e29ac7869029 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:15.835501 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-603b3cb3-4e32-4e18-8217-e29ac7869029 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:15.835938 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-603b3cb3-4e32-4e18-8217-e29ac7869029 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:15.836734 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-603b3cb3-4e32-4e18-8217-e29ac7869029 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:15.837152 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-603b3cb3-4e32-4e18-8217-e29ac7869029 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:15.839148 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-e73e5a40-58eb-4046-82bc-537fceb462b3 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "POST /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288/action" status: 202 len: 0 microversion: 2.1 time: 0.165948 Apr 08 02:50:15.839741 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 241/486] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Apr 8 02:50:15 2022] POST /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 02:50:15.856383 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-af91c419-3cd5-4641-a65f-71f1ad2a1bd4 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:15.857094 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-af91c419-3cd5-4641-a65f-71f1ad2a1bd4 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 19ff8616-8e62-40fe-87e7-f976433b9288] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:15.865452 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-af91c419-3cd5-4641-a65f-71f1ad2a1bd4 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:15.865906 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-af91c419-3cd5-4641-a65f-71f1ad2a1bd4 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:15.866707 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-af91c419-3cd5-4641-a65f-71f1ad2a1bd4 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:15.867149 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-af91c419-3cd5-4641-a65f-71f1ad2a1bd4 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:16.150869 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-af91c419-3cd5-4641-a65f-71f1ad2a1bd4 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a88a8d7c9e4d0a88308c0e894570be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c31bb4f3ce486591bc142b1da7553e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:16.154619 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-603b3cb3-4e32-4e18-8217-e29ac7869029 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:16.159538 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-af91c419-3cd5-4641-a65f-71f1ad2a1bd4 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288" status: 200 len: 1707 microversion: 2.1 time: 0.315513 Apr 08 02:50:16.160077 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 242/487] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:15 2022] GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288 => generated 1707 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:50:16.170072 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-f5fe9d88-b4c5-4fc1-bf7b-857503d1e040 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:16.170694 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-f5fe9d88-b4c5-4fc1-bf7b-857503d1e040 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] [instance: 59d316c0-ed6c-470a-b33f-30b42537143f] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:16.177341 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-603b3cb3-4e32-4e18-8217-e29ac7869029 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:16.177689 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-f5fe9d88-b4c5-4fc1-bf7b-857503d1e040 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:16.178135 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-f5fe9d88-b4c5-4fc1-bf7b-857503d1e040 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:16.178949 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-f5fe9d88-b4c5-4fc1-bf7b-857503d1e040 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:16.179375 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-f5fe9d88-b4c5-4fc1-bf7b-857503d1e040 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:16.184249 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-603b3cb3-4e32-4e18-8217-e29ac7869029 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:16.185389 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-603b3cb3-4e32-4e18-8217-e29ac7869029 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1810 microversion: 2.20 time: 0.368077 Apr 08 02:50:16.186122 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 246/488] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:50:15 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1810 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:50:16.254986 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-f5fe9d88-b4c5-4fc1-bf7b-857503d1e040 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:16.255647 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-f5fe9d88-b4c5-4fc1-bf7b-857503d1e040 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:16.256252 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.objects.instance [None req-f5fe9d88-b4c5-4fc1-bf7b-857503d1e040 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lazy-loading 'fault' on Instance uuid 59d316c0-ed6c-470a-b33f-30b42537143f {{(pid=96919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 08 02:50:16.323156 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-f5fe9d88-b4c5-4fc1-bf7b-857503d1e040 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b94017d79f24adaa76748899bc7c014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fb44db14d6e4c14b82c05f28e8ee9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:16.331294 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-f5fe9d88-b4c5-4fc1-bf7b-857503d1e040 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] 10.222.0.48 "GET /compute/v2.1/servers/59d316c0-ed6c-470a-b33f-30b42537143f" status: 200 len: 1308 microversion: 2.1 time: 0.169938 Apr 08 02:50:16.331855 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 243/489] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:16 2022] GET /compute/v2.1/servers/59d316c0-ed6c-470a-b33f-30b42537143f => generated 1308 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:50:17.181683 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-1c1dff7d-e12d-4c49-8614-46afb434eb51 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:17.182279 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-1c1dff7d-e12d-4c49-8614-46afb434eb51 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 19ff8616-8e62-40fe-87e7-f976433b9288] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:17.189438 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-1c1dff7d-e12d-4c49-8614-46afb434eb51 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:17.189872 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-1c1dff7d-e12d-4c49-8614-46afb434eb51 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:17.190618 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-1c1dff7d-e12d-4c49-8614-46afb434eb51 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:17.191062 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-1c1dff7d-e12d-4c49-8614-46afb434eb51 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:17.208513 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-7e0604de-08ed-4116-8782-ef0c664f3e92 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:17.209105 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-7e0604de-08ed-4116-8782-ef0c664f3e92 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:17.216176 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-7e0604de-08ed-4116-8782-ef0c664f3e92 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:17.216607 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-7e0604de-08ed-4116-8782-ef0c664f3e92 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:17.217359 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-7e0604de-08ed-4116-8782-ef0c664f3e92 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:17.217782 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-7e0604de-08ed-4116-8782-ef0c664f3e92 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:17.479485 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-1c1dff7d-e12d-4c49-8614-46afb434eb51 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a88a8d7c9e4d0a88308c0e894570be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c31bb4f3ce486591bc142b1da7553e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:17.488157 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-7e0604de-08ed-4116-8782-ef0c664f3e92 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:17.488342 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-1c1dff7d-e12d-4c49-8614-46afb434eb51 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288" status: 200 len: 1707 microversion: 2.1 time: 0.316027 Apr 08 02:50:17.488853 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 247/490] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:17 2022] GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288 => generated 1707 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:50:17.499817 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-463e6165-d3b9-444b-8ab9-c3d13eec4db7 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:17.500411 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-463e6165-d3b9-444b-8ab9-c3d13eec4db7 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] [instance: 59d316c0-ed6c-470a-b33f-30b42537143f] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:17.502485 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-7e0604de-08ed-4116-8782-ef0c664f3e92 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:17.507474 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-463e6165-d3b9-444b-8ab9-c3d13eec4db7 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:17.507922 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-463e6165-d3b9-444b-8ab9-c3d13eec4db7 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:17.508559 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-7e0604de-08ed-4116-8782-ef0c664f3e92 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:17.509206 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-463e6165-d3b9-444b-8ab9-c3d13eec4db7 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:17.509650 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-463e6165-d3b9-444b-8ab9-c3d13eec4db7 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:17.509766 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-7e0604de-08ed-4116-8782-ef0c664f3e92 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1810 microversion: 2.20 time: 0.310122 Apr 08 02:50:17.510218 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 244/491] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:50:17 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1810 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 02:50:17.564173 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.wsgi [None req-463e6165-d3b9-444b-8ab9-c3d13eec4db7 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] HTTP exception thrown: Instance 59d316c0-ed6c-470a-b33f-30b42537143f could not be found. Apr 08 02:50:17.564692 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-463e6165-d3b9-444b-8ab9-c3d13eec4db7 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] Returning 404 to user: Instance 59d316c0-ed6c-470a-b33f-30b42537143f could not be found. {{(pid=96920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Apr 08 02:50:17.565516 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-463e6165-d3b9-444b-8ab9-c3d13eec4db7 tempest-VolumesSnapshotTestJSON-173334629 tempest-VolumesSnapshotTestJSON-173334629-project] 10.222.0.48 "GET /compute/v2.1/servers/59d316c0-ed6c-470a-b33f-30b42537143f" status: 404 len: 111 microversion: 2.1 time: 0.075697 Apr 08 02:50:17.566061 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 248/492] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:17 2022] GET /compute/v2.1/servers/59d316c0-ed6c-470a-b33f-30b42537143f => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 02:50:18.511736 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-9726d2b4-dc0e-4ceb-a9c6-3ee45a5993b5 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:18.512601 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-9726d2b4-dc0e-4ceb-a9c6-3ee45a5993b5 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 19ff8616-8e62-40fe-87e7-f976433b9288] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:18.519618 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-9726d2b4-dc0e-4ceb-a9c6-3ee45a5993b5 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:18.520056 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-9726d2b4-dc0e-4ceb-a9c6-3ee45a5993b5 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:18.520803 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-9726d2b4-dc0e-4ceb-a9c6-3ee45a5993b5 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:18.521227 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-9726d2b4-dc0e-4ceb-a9c6-3ee45a5993b5 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:18.533429 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-68f943a8-ecbc-4c84-89b6-8f7051f1efd5 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:18.534043 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-68f943a8-ecbc-4c84-89b6-8f7051f1efd5 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:18.541355 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-68f943a8-ecbc-4c84-89b6-8f7051f1efd5 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:18.541791 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-68f943a8-ecbc-4c84-89b6-8f7051f1efd5 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:18.542541 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-68f943a8-ecbc-4c84-89b6-8f7051f1efd5 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:18.542992 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-68f943a8-ecbc-4c84-89b6-8f7051f1efd5 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:18.819177 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-68f943a8-ecbc-4c84-89b6-8f7051f1efd5 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:18.821413 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-9726d2b4-dc0e-4ceb-a9c6-3ee45a5993b5 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a88a8d7c9e4d0a88308c0e894570be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c31bb4f3ce486591bc142b1da7553e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:18.829717 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-9726d2b4-dc0e-4ceb-a9c6-3ee45a5993b5 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288" status: 200 len: 1711 microversion: 2.1 time: 0.327506 Apr 08 02:50:18.830272 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 245/493] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:18 2022] GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288 => generated 1711 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:50:18.832981 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-68f943a8-ecbc-4c84-89b6-8f7051f1efd5 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:18.839158 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-68f943a8-ecbc-4c84-89b6-8f7051f1efd5 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:18.840246 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-68f943a8-ecbc-4c84-89b6-8f7051f1efd5 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1810 microversion: 2.20 time: 0.315700 Apr 08 02:50:18.840829 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 249/494] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:50:18 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1810 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 02:50:19.864104 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-a35e6be8-eb98-486f-a3bb-fbf20c51eba1 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:19.864702 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-a35e6be8-eb98-486f-a3bb-fbf20c51eba1 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:19.873076 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-a35e6be8-eb98-486f-a3bb-fbf20c51eba1 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:19.873517 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-a35e6be8-eb98-486f-a3bb-fbf20c51eba1 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:19.874270 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-a35e6be8-eb98-486f-a3bb-fbf20c51eba1 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:19.874711 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-a35e6be8-eb98-486f-a3bb-fbf20c51eba1 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:20.132431 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-a35e6be8-eb98-486f-a3bb-fbf20c51eba1 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:20.146511 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-a35e6be8-eb98-486f-a3bb-fbf20c51eba1 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:20.153419 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-a35e6be8-eb98-486f-a3bb-fbf20c51eba1 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:20.154522 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-a35e6be8-eb98-486f-a3bb-fbf20c51eba1 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1810 microversion: 2.20 time: 0.299541 Apr 08 02:50:20.155087 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 246/495] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:50:19 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1810 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:50:21.177166 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-85e967ff-ba34-4932-a3b8-930aa9657d4f tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:21.177761 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-85e967ff-ba34-4932-a3b8-930aa9657d4f tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:21.185812 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-85e967ff-ba34-4932-a3b8-930aa9657d4f tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:21.186259 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-85e967ff-ba34-4932-a3b8-930aa9657d4f tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:21.187054 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-85e967ff-ba34-4932-a3b8-930aa9657d4f tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:21.187521 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-85e967ff-ba34-4932-a3b8-930aa9657d4f tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:21.394655 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-85e967ff-ba34-4932-a3b8-930aa9657d4f tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:21.409265 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-85e967ff-ba34-4932-a3b8-930aa9657d4f tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:21.415510 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-85e967ff-ba34-4932-a3b8-930aa9657d4f tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:21.416601 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-85e967ff-ba34-4932-a3b8-930aa9657d4f tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1810 microversion: 2.20 time: 0.248409 Apr 08 02:50:21.417242 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 250/496] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:50:21 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1810 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:50:22.108286 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-3ea6a136-3db5-4054-9d25-142046b10dd5 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ed472012-97bc-4464-95ac-915df5116649"}} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:50:22.109415 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-3ea6a136-3db5-4054-9d25-142046b10dd5 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 1b72863f-5373-4ef6-b303-1b7955cafa96] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:22.117221 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-3ea6a136-3db5-4054-9d25-142046b10dd5 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:22.117730 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-3ea6a136-3db5-4054-9d25-142046b10dd5 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:22.118772 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-3ea6a136-3db5-4054-9d25-142046b10dd5 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:22.119203 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-3ea6a136-3db5-4054-9d25-142046b10dd5 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:22.448415 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-65f51e8d-9405-4f0f-82a9-73de2611c0e0 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:22.449113 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-65f51e8d-9405-4f0f-82a9-73de2611c0e0 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:22.456688 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-65f51e8d-9405-4f0f-82a9-73de2611c0e0 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:22.457401 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-65f51e8d-9405-4f0f-82a9-73de2611c0e0 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:22.458238 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-65f51e8d-9405-4f0f-82a9-73de2611c0e0 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:22.458766 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-65f51e8d-9405-4f0f-82a9-73de2611c0e0 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:22.596570 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 08 02:50:22.597086 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: Fri Apr 8 02:50:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96/os-volume_attachments (ip 10.222.0.48) !!! Apr 08 02:50:22.680865 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-65f51e8d-9405-4f0f-82a9-73de2611c0e0 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:22.697286 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-65f51e8d-9405-4f0f-82a9-73de2611c0e0 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:22.705608 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-65f51e8d-9405-4f0f-82a9-73de2611c0e0 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:22.707156 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-65f51e8d-9405-4f0f-82a9-73de2611c0e0 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1810 microversion: 2.20 time: 0.275322 Apr 08 02:50:22.719263 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 251/497] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:50:22 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1810 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:50:23.732690 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-3204deb9-a63b-4f9b-b9c5-ebc7d07db10a tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:23.733317 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-3204deb9-a63b-4f9b-b9c5-ebc7d07db10a tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:23.740485 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-3204deb9-a63b-4f9b-b9c5-ebc7d07db10a tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:23.740921 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-3204deb9-a63b-4f9b-b9c5-ebc7d07db10a tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:23.741895 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-3204deb9-a63b-4f9b-b9c5-ebc7d07db10a tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:23.742318 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-3204deb9-a63b-4f9b-b9c5-ebc7d07db10a tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:23.964011 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-3204deb9-a63b-4f9b-b9c5-ebc7d07db10a tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:23.979867 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-3204deb9-a63b-4f9b-b9c5-ebc7d07db10a tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:23.986158 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-3204deb9-a63b-4f9b-b9c5-ebc7d07db10a tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:23.987420 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-3204deb9-a63b-4f9b-b9c5-ebc7d07db10a tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1810 microversion: 2.20 time: 0.264287 Apr 08 02:50:23.987950 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 252/498] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:50:23 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1810 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 02:50:25.011192 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-2d643acf-b439-4cca-b04c-b38b98b1bf9d tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:25.011847 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-2d643acf-b439-4cca-b04c-b38b98b1bf9d tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:25.019256 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-2d643acf-b439-4cca-b04c-b38b98b1bf9d tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:25.019698 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-2d643acf-b439-4cca-b04c-b38b98b1bf9d tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:25.020458 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-2d643acf-b439-4cca-b04c-b38b98b1bf9d tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:25.020885 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-2d643acf-b439-4cca-b04c-b38b98b1bf9d tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:25.217969 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-2d643acf-b439-4cca-b04c-b38b98b1bf9d tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:25.232580 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-2d643acf-b439-4cca-b04c-b38b98b1bf9d tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:25.238645 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-2d643acf-b439-4cca-b04c-b38b98b1bf9d tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:25.239743 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-2d643acf-b439-4cca-b04c-b38b98b1bf9d tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1810 microversion: 2.20 time: 0.238397 Apr 08 02:50:25.240261 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 253/499] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:50:25 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1810 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 02:50:26.265257 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-bf397281-1644-4835-aa73-1a869180b575 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:26.265887 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-bf397281-1644-4835-aa73-1a869180b575 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:26.275123 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-bf397281-1644-4835-aa73-1a869180b575 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:26.275618 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-bf397281-1644-4835-aa73-1a869180b575 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:26.276682 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-bf397281-1644-4835-aa73-1a869180b575 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:26.277107 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-bf397281-1644-4835-aa73-1a869180b575 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:26.477897 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-bf397281-1644-4835-aa73-1a869180b575 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:26.491284 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-bf397281-1644-4835-aa73-1a869180b575 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:26.497942 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-bf397281-1644-4835-aa73-1a869180b575 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:26.499044 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-bf397281-1644-4835-aa73-1a869180b575 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1810 microversion: 2.20 time: 0.243865 Apr 08 02:50:26.499562 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 254/500] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:50:26 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1810 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 02:50:26.994389 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-3ea6a136-3db5-4054-9d25-142046b10dd5 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "POST /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.033736 Apr 08 02:50:26.995048 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 247/501] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Apr 8 02:50:21 2022] POST /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96/os-volume_attachments => generated 194 bytes in 5036 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:50:27.523037 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-f1e97f79-c9b6-4bb3-beef-67ef6c716357 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:27.523693 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-f1e97f79-c9b6-4bb3-beef-67ef6c716357 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:27.530975 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-f1e97f79-c9b6-4bb3-beef-67ef6c716357 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:27.531413 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-f1e97f79-c9b6-4bb3-beef-67ef6c716357 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:27.532164 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-f1e97f79-c9b6-4bb3-beef-67ef6c716357 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:27.532586 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-f1e97f79-c9b6-4bb3-beef-67ef6c716357 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:27.734495 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-f1e97f79-c9b6-4bb3-beef-67ef6c716357 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:27.748675 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-f1e97f79-c9b6-4bb3-beef-67ef6c716357 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:27.755176 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-f1e97f79-c9b6-4bb3-beef-67ef6c716357 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:27.756296 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-f1e97f79-c9b6-4bb3-beef-67ef6c716357 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1810 microversion: 2.20 time: 0.242997 Apr 08 02:50:27.764739 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 255/502] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:50:27 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1810 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:50:28.785314 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-6a085126-b82b-4877-8a9a-4269a4b9c1b4 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:28.786162 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-6a085126-b82b-4877-8a9a-4269a4b9c1b4 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:28.795660 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-6a085126-b82b-4877-8a9a-4269a4b9c1b4 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:28.796112 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-6a085126-b82b-4877-8a9a-4269a4b9c1b4 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:28.796902 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-6a085126-b82b-4877-8a9a-4269a4b9c1b4 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:28.797343 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-6a085126-b82b-4877-8a9a-4269a4b9c1b4 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:29.027170 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-6a085126-b82b-4877-8a9a-4269a4b9c1b4 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:29.042587 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-6a085126-b82b-4877-8a9a-4269a4b9c1b4 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:29.049859 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-6a085126-b82b-4877-8a9a-4269a4b9c1b4 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:29.051314 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-6a085126-b82b-4877-8a9a-4269a4b9c1b4 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1810 microversion: 2.20 time: 0.280505 Apr 08 02:50:29.052234 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 248/503] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:50:28 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1810 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:50:30.075777 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-44c468b6-5bf3-49c1-8010-a6226adebee0 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:30.076367 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-44c468b6-5bf3-49c1-8010-a6226adebee0 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:30.083780 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-44c468b6-5bf3-49c1-8010-a6226adebee0 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:30.084212 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-44c468b6-5bf3-49c1-8010-a6226adebee0 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:30.084972 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-44c468b6-5bf3-49c1-8010-a6226adebee0 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:30.085377 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-44c468b6-5bf3-49c1-8010-a6226adebee0 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:30.287729 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-44c468b6-5bf3-49c1-8010-a6226adebee0 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:30.302852 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-44c468b6-5bf3-49c1-8010-a6226adebee0 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:30.309567 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-44c468b6-5bf3-49c1-8010-a6226adebee0 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:30.310911 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-44c468b6-5bf3-49c1-8010-a6226adebee0 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1810 microversion: 2.20 time: 0.244269 Apr 08 02:50:30.311445 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 256/504] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:50:30 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1810 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:50:31.334338 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-b88d1636-bf27-4729-a946-20027d228621 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:31.334957 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-b88d1636-bf27-4729-a946-20027d228621 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:31.343323 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b88d1636-bf27-4729-a946-20027d228621 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:31.343767 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b88d1636-bf27-4729-a946-20027d228621 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:31.344531 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b88d1636-bf27-4729-a946-20027d228621 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:31.344960 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b88d1636-bf27-4729-a946-20027d228621 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:31.513000 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-f02fcabb-06c5-4a22-ad6d-90aafc0b3ad4 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1737820744", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-386305352", "security_groups": [{"name": "tempest-secgroup-smoke-1418041859"}], "networks": [{"uuid": "7e024dc7-08f6-4065-988a-c132275bafc0"}], "block_device_mapping_v2": [{"uuid": "8802003f-cb37-4cce-bb00-c9bedb1e356b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:50:31.552462 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-b88d1636-bf27-4729-a946-20027d228621 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:31.567240 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-b88d1636-bf27-4729-a946-20027d228621 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:31.573801 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-b88d1636-bf27-4729-a946-20027d228621 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:31.574943 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-b88d1636-bf27-4729-a946-20027d228621 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1810 microversion: 2.20 time: 0.249603 Apr 08 02:50:31.575473 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 249/505] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:50:31 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1810 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:50:31.688065 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.network.neutron [None req-f02fcabb-06c5-4a22-ad6d-90aafc0b3ad4 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] validate_networks() for [('7e024dc7-08f6-4065-988a-c132275bafc0', None, None, None)] {{(pid=96920) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} Apr 08 02:50:31.796320 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [req-f49876cc-3a3a-4a1c-b1f7-0507b2ab27cc req-7296c211-6085-447f-9e7a-ca7f3edded30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e44bc1d2-0741-4081-9165-b0aca9008eaf", "name": "network-vif-plugged", "status": "completed", "tag": "e1447a33-5dc8-44ca-8978-a2f1cdaaab34"}]} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:50:31.802487 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:50:31.802487 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: warnings.warn(msg) Apr 08 02:50:31.811274 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-f49876cc-3a3a-4a1c-b1f7-0507b2ab27cc req-7296c211-6085-447f-9e7a-ca7f3edded30 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:31.811718 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-f49876cc-3a3a-4a1c-b1f7-0507b2ab27cc req-7296c211-6085-447f-9e7a-ca7f3edded30 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:31.827199 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.compute.server_external_events [req-f49876cc-3a3a-4a1c-b1f7-0507b2ab27cc req-7296c211-6085-447f-9e7a-ca7f3edded30 service nova] Creating event network-vif-plugged:e1447a33-5dc8-44ca-8978-a2f1cdaaab34 for instance e44bc1d2-0741-4081-9165-b0aca9008eaf on hv-cinder-83705 Apr 08 02:50:31.831895 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [req-f49876cc-3a3a-4a1c-b1f7-0507b2ab27cc req-7296c211-6085-447f-9e7a-ca7f3edded30 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124706 Apr 08 02:50:31.832479 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 250/506] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:50:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 02:50:32.220929 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.virt.hardware [None req-f02fcabb-06c5-4a22-ad6d-90aafc0b3ad4 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Flavor limits 0:0:0 {{(pid=96920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} Apr 08 02:50:32.221444 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.virt.hardware [None req-f02fcabb-06c5-4a22-ad6d-90aafc0b3ad4 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Image limits 0:0:0 {{(pid=96920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} Apr 08 02:50:32.221976 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.virt.hardware [None req-f02fcabb-06c5-4a22-ad6d-90aafc0b3ad4 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Flavor pref 0:0:0 {{(pid=96920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} Apr 08 02:50:32.222460 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.virt.hardware [None req-f02fcabb-06c5-4a22-ad6d-90aafc0b3ad4 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Image pref 0:0:0 {{(pid=96920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} Apr 08 02:50:32.223044 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.virt.hardware [None req-f02fcabb-06c5-4a22-ad6d-90aafc0b3ad4 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=96920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} Apr 08 02:50:32.235881 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-f02fcabb-06c5-4a22-ad6d-90aafc0b3ad4 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:32.236549 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-f02fcabb-06c5-4a22-ad6d-90aafc0b3ad4 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:32.237360 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-f02fcabb-06c5-4a22-ad6d-90aafc0b3ad4 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:32.237796 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-f02fcabb-06c5-4a22-ad6d-90aafc0b3ad4 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:32.256052 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.quota [None req-f02fcabb-06c5-4a22-ad6d-90aafc0b3ad4 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Getting quotas for project 89f311117084470f8e8d16c47ad1d2ae. Resources: {'instances', 'cores', 'ram'} {{(pid=96920) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:50:32.260555 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.quota [None req-f02fcabb-06c5-4a22-ad6d-90aafc0b3ad4 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Getting quotas for user a86a950d41cc44fb9f10b600b20b0ae6 and project 89f311117084470f8e8d16c47ad1d2ae. Resources: {'instances', 'cores', 'ram'} {{(pid=96920) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:50:32.349896 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-f02fcabb-06c5-4a22-ad6d-90aafc0b3ad4 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Going to run 1 instances... {{(pid=96920) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} Apr 08 02:50:32.352088 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-f02fcabb-06c5-4a22-ad6d-90aafc0b3ad4 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] [instance: 2fb4b617-e0c5-4496-858f-f139414f8fb5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8802003f-cb37-4cce-bb00-c9bedb1e356b',volume_size=None,volume_type=None)] {{(pid=96920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} Apr 08 02:50:32.533481 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-f02fcabb-06c5-4a22-ad6d-90aafc0b3ad4 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.030279 Apr 08 02:50:32.534414 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 257/507] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Apr 8 02:50:31 2022] POST /compute/v2.1/servers => generated 406 bytes in 1032 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 08 02:50:32.550592 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-d7f30288-0805-4486-ac3f-b48a8508f52c tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:32.551305 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-d7f30288-0805-4486-ac3f-b48a8508f52c tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] [instance: 2fb4b617-e0c5-4496-858f-f139414f8fb5] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:32.599020 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-7f205d78-c071-4109-947f-b2dd43280336 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:32.599472 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-7f205d78-c071-4109-947f-b2dd43280336 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:32.609980 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-7f205d78-c071-4109-947f-b2dd43280336 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:32.610426 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-7f205d78-c071-4109-947f-b2dd43280336 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:32.611249 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-7f205d78-c071-4109-947f-b2dd43280336 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:32.611675 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-7f205d78-c071-4109-947f-b2dd43280336 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:32.630936 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-d7f30288-0805-4486-ac3f-b48a8508f52c tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86a950d41cc44fb9f10b600b20b0ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f311117084470f8e8d16c47ad1d2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:32.639463 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-d7f30288-0805-4486-ac3f-b48a8508f52c tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] 10.222.0.48 "GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5" status: 200 len: 1088 microversion: 2.1 time: 0.098911 Apr 08 02:50:32.642707 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 251/508] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:32 2022] GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5 => generated 1088 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:50:32.820540 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-7f205d78-c071-4109-947f-b2dd43280336 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:32.834997 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-7f205d78-c071-4109-947f-b2dd43280336 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:32.841200 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-7f205d78-c071-4109-947f-b2dd43280336 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:32.842293 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-7f205d78-c071-4109-947f-b2dd43280336 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1810 microversion: 2.20 time: 0.252469 Apr 08 02:50:32.842841 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 258/509] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:50:32 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1810 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 02:50:33.661611 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-64c65d37-ad16-40e5-8581-0fa75fd365da tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:33.662205 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-64c65d37-ad16-40e5-8581-0fa75fd365da tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] [instance: 2fb4b617-e0c5-4496-858f-f139414f8fb5] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:33.671034 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-64c65d37-ad16-40e5-8581-0fa75fd365da tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:33.671473 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-64c65d37-ad16-40e5-8581-0fa75fd365da tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:33.672220 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-64c65d37-ad16-40e5-8581-0fa75fd365da tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:33.672652 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-64c65d37-ad16-40e5-8581-0fa75fd365da tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:33.792064 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-64c65d37-ad16-40e5-8581-0fa75fd365da tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86a950d41cc44fb9f10b600b20b0ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f311117084470f8e8d16c47ad1d2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:33.799989 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-64c65d37-ad16-40e5-8581-0fa75fd365da tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] 10.222.0.48 "GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5" status: 200 len: 1138 microversion: 2.1 time: 0.147213 Apr 08 02:50:33.800513 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 252/510] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:33 2022] GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5 => generated 1138 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:50:33.865177 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-bc356c94-31a9-4403-b4f5-5826dabca751 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:33.865764 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-bc356c94-31a9-4403-b4f5-5826dabca751 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:33.873000 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-bc356c94-31a9-4403-b4f5-5826dabca751 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:33.873433 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-bc356c94-31a9-4403-b4f5-5826dabca751 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:33.874178 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-bc356c94-31a9-4403-b4f5-5826dabca751 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:33.874597 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-bc356c94-31a9-4403-b4f5-5826dabca751 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:34.123021 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-bc356c94-31a9-4403-b4f5-5826dabca751 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:34.137456 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-bc356c94-31a9-4403-b4f5-5826dabca751 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:34.143495 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-bc356c94-31a9-4403-b4f5-5826dabca751 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:34.144576 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-bc356c94-31a9-4403-b4f5-5826dabca751 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1810 microversion: 2.20 time: 0.288270 Apr 08 02:50:34.145088 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 259/511] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:50:33 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1810 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:50:34.821961 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-cc54b127-340c-47ca-9be0-76fd3f39f943 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:34.822601 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-cc54b127-340c-47ca-9be0-76fd3f39f943 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] [instance: 2fb4b617-e0c5-4496-858f-f139414f8fb5] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:34.829704 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-cc54b127-340c-47ca-9be0-76fd3f39f943 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:34.830183 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-cc54b127-340c-47ca-9be0-76fd3f39f943 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:34.830965 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-cc54b127-340c-47ca-9be0-76fd3f39f943 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:34.831394 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-cc54b127-340c-47ca-9be0-76fd3f39f943 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:34.947340 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-cc54b127-340c-47ca-9be0-76fd3f39f943 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86a950d41cc44fb9f10b600b20b0ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f311117084470f8e8d16c47ad1d2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:34.955249 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-cc54b127-340c-47ca-9be0-76fd3f39f943 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] 10.222.0.48 "GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5" status: 200 len: 1138 microversion: 2.1 time: 0.142532 Apr 08 02:50:34.955773 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 253/512] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:34 2022] GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5 => generated 1138 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:50:35.168933 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-9d05b6dd-a74c-4595-b015-2a1d0041cc60 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:35.169514 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-9d05b6dd-a74c-4595-b015-2a1d0041cc60 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:35.176653 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-9d05b6dd-a74c-4595-b015-2a1d0041cc60 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:35.177085 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-9d05b6dd-a74c-4595-b015-2a1d0041cc60 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:35.177838 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-9d05b6dd-a74c-4595-b015-2a1d0041cc60 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:35.178256 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-9d05b6dd-a74c-4595-b015-2a1d0041cc60 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:35.380361 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-9d05b6dd-a74c-4595-b015-2a1d0041cc60 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:35.394733 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-9d05b6dd-a74c-4595-b015-2a1d0041cc60 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:35.401405 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-9d05b6dd-a74c-4595-b015-2a1d0041cc60 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:35.402483 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-9d05b6dd-a74c-4595-b015-2a1d0041cc60 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1810 microversion: 2.20 time: 0.243106 Apr 08 02:50:35.403037 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 260/513] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:50:35 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1810 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:50:35.977445 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-2bea663c-c979-46eb-825c-7e7a9ec048dd tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:35.978103 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-2bea663c-c979-46eb-825c-7e7a9ec048dd tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] [instance: 2fb4b617-e0c5-4496-858f-f139414f8fb5] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:35.985720 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-2bea663c-c979-46eb-825c-7e7a9ec048dd tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:35.986167 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-2bea663c-c979-46eb-825c-7e7a9ec048dd tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:35.986962 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-2bea663c-c979-46eb-825c-7e7a9ec048dd tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:35.987403 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-2bea663c-c979-46eb-825c-7e7a9ec048dd tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:36.105565 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-2bea663c-c979-46eb-825c-7e7a9ec048dd tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86a950d41cc44fb9f10b600b20b0ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f311117084470f8e8d16c47ad1d2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:36.113436 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-2bea663c-c979-46eb-825c-7e7a9ec048dd tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] 10.222.0.48 "GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5" status: 200 len: 1138 microversion: 2.1 time: 0.145024 Apr 08 02:50:36.113968 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 254/514] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:35 2022] GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5 => generated 1138 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:50:36.425915 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-cc9e67a6-8544-4c28-bc61-8584d60e4839 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:36.426507 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-cc9e67a6-8544-4c28-bc61-8584d60e4839 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:36.433714 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-cc9e67a6-8544-4c28-bc61-8584d60e4839 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:36.434152 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-cc9e67a6-8544-4c28-bc61-8584d60e4839 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:36.434972 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-cc9e67a6-8544-4c28-bc61-8584d60e4839 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:36.435400 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-cc9e67a6-8544-4c28-bc61-8584d60e4839 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:36.637665 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-cc9e67a6-8544-4c28-bc61-8584d60e4839 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:36.651212 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-cc9e67a6-8544-4c28-bc61-8584d60e4839 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:36.657213 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-cc9e67a6-8544-4c28-bc61-8584d60e4839 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:36.658293 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-cc9e67a6-8544-4c28-bc61-8584d60e4839 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1810 microversion: 2.20 time: 0.241291 Apr 08 02:50:36.658834 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 261/515] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:50:36 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1810 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:50:37.135897 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-62cbd3ad-775b-44e2-a0a4-1a90ef090029 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:37.136494 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-62cbd3ad-775b-44e2-a0a4-1a90ef090029 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] [instance: 2fb4b617-e0c5-4496-858f-f139414f8fb5] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:37.143917 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-62cbd3ad-775b-44e2-a0a4-1a90ef090029 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:37.144358 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-62cbd3ad-775b-44e2-a0a4-1a90ef090029 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:37.145118 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-62cbd3ad-775b-44e2-a0a4-1a90ef090029 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:37.145546 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-62cbd3ad-775b-44e2-a0a4-1a90ef090029 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:37.268074 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-62cbd3ad-775b-44e2-a0a4-1a90ef090029 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86a950d41cc44fb9f10b600b20b0ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f311117084470f8e8d16c47ad1d2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:37.276518 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-62cbd3ad-775b-44e2-a0a4-1a90ef090029 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] 10.222.0.48 "GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5" status: 200 len: 1138 microversion: 2.1 time: 0.149693 Apr 08 02:50:37.277047 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 255/516] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:37 2022] GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5 => generated 1138 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:50:37.681822 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-ffac0071-24b8-4952-b539-51d1a9ed58d7 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:37.682416 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-ffac0071-24b8-4952-b539-51d1a9ed58d7 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:37.689654 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-ffac0071-24b8-4952-b539-51d1a9ed58d7 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:37.690092 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-ffac0071-24b8-4952-b539-51d1a9ed58d7 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:37.690874 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-ffac0071-24b8-4952-b539-51d1a9ed58d7 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:37.691294 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-ffac0071-24b8-4952-b539-51d1a9ed58d7 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:37.902879 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-ffac0071-24b8-4952-b539-51d1a9ed58d7 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:37.918734 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-ffac0071-24b8-4952-b539-51d1a9ed58d7 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:37.924952 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-ffac0071-24b8-4952-b539-51d1a9ed58d7 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:37.926346 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-ffac0071-24b8-4952-b539-51d1a9ed58d7 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1810 microversion: 2.20 time: 0.253686 Apr 08 02:50:37.926904 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 262/517] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:50:37 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1810 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:50:38.298901 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-60ea0508-3a48-4957-860d-85da640dbbde tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:38.299461 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-60ea0508-3a48-4957-860d-85da640dbbde tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] [instance: 2fb4b617-e0c5-4496-858f-f139414f8fb5] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:38.307245 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-60ea0508-3a48-4957-860d-85da640dbbde tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:38.307686 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-60ea0508-3a48-4957-860d-85da640dbbde tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:38.308449 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-60ea0508-3a48-4957-860d-85da640dbbde tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:38.308873 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-60ea0508-3a48-4957-860d-85da640dbbde tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:38.434812 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-60ea0508-3a48-4957-860d-85da640dbbde tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86a950d41cc44fb9f10b600b20b0ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f311117084470f8e8d16c47ad1d2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:38.444925 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-60ea0508-3a48-4957-860d-85da640dbbde tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] 10.222.0.48 "GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5" status: 200 len: 1186 microversion: 2.1 time: 0.155726 Apr 08 02:50:38.446729 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 256/518] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:38 2022] GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5 => generated 1186 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:50:38.963802 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-2569a8eb-387f-473f-a72f-118ce9fc822a tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:38.965552 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-2569a8eb-387f-473f-a72f-118ce9fc822a tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:38.982447 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-2569a8eb-387f-473f-a72f-118ce9fc822a tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:38.983397 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-2569a8eb-387f-473f-a72f-118ce9fc822a tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:38.984709 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-2569a8eb-387f-473f-a72f-118ce9fc822a tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:38.986523 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-2569a8eb-387f-473f-a72f-118ce9fc822a tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:39.456468 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-2569a8eb-387f-473f-a72f-118ce9fc822a tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:39.473277 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-ddfe5507-22bc-4944-b374-efb1355a765e tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:39.474166 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-ddfe5507-22bc-4944-b374-efb1355a765e tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] [instance: 2fb4b617-e0c5-4496-858f-f139414f8fb5] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:39.491554 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ddfe5507-22bc-4944-b374-efb1355a765e tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:39.492065 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ddfe5507-22bc-4944-b374-efb1355a765e tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:39.496086 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-2569a8eb-387f-473f-a72f-118ce9fc822a tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:39.496935 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ddfe5507-22bc-4944-b374-efb1355a765e tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:39.497499 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ddfe5507-22bc-4944-b374-efb1355a765e tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:39.504765 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-2569a8eb-387f-473f-a72f-118ce9fc822a tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:39.506551 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-2569a8eb-387f-473f-a72f-118ce9fc822a tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1810 microversion: 2.20 time: 0.564774 Apr 08 02:50:39.521314 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 263/519] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:50:38 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1810 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:50:39.738513 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-ddfe5507-22bc-4944-b374-efb1355a765e tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86a950d41cc44fb9f10b600b20b0ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f311117084470f8e8d16c47ad1d2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:39.747515 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-ddfe5507-22bc-4944-b374-efb1355a765e tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] 10.222.0.48 "GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5" status: 200 len: 1272 microversion: 2.1 time: 0.287967 Apr 08 02:50:39.757108 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 257/520] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:39 2022] GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5 => generated 1272 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:50:40.452878 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-f1327425-8a77-4bf5-b621-58859b6ac2ed tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:50:40.454467 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-f1327425-8a77-4bf5-b621-58859b6ac2ed tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 1b72863f-5373-4ef6-b303-1b7955cafa96] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:40.463117 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-f1327425-8a77-4bf5-b621-58859b6ac2ed tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:40.463747 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-f1327425-8a77-4bf5-b621-58859b6ac2ed tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:40.464686 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-f1327425-8a77-4bf5-b621-58859b6ac2ed tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:40.465111 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-f1327425-8a77-4bf5-b621-58859b6ac2ed tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:40.533281 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-14f56a61-f183-4296-a6c7-fcb41d18f7d7 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:40.534628 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-14f56a61-f183-4296-a6c7-fcb41d18f7d7 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:40.545650 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-14f56a61-f183-4296-a6c7-fcb41d18f7d7 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:40.546106 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-14f56a61-f183-4296-a6c7-fcb41d18f7d7 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:40.547082 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-14f56a61-f183-4296-a6c7-fcb41d18f7d7 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:40.547516 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-14f56a61-f183-4296-a6c7-fcb41d18f7d7 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:40.553277 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.objects.instance [None req-f1327425-8a77-4bf5-b621-58859b6ac2ed tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lazy-loading 'flavor' on Instance uuid 1b72863f-5373-4ef6-b303-1b7955cafa96 {{(pid=96920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 08 02:50:40.827230 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-14f56a61-f183-4296-a6c7-fcb41d18f7d7 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:40.827773 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-f1327425-8a77-4bf5-b621-58859b6ac2ed tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "POST /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96/action" status: 200 len: 32 microversion: 2.1 time: 0.384234 Apr 08 02:50:40.828827 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 264/521] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Apr 8 02:50:40 2022] POST /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96/action => generated 32 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 08 02:50:40.845351 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [req-e3b7664c-50f9-4390-8ec6-fcce231c40e7 req-94ee2793-45da-4117-8135-b081d5db0802 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fb4b617-e0c5-4496-858f-f139414f8fb5", "tag": "1be6ca01-4620-4592-8649-c93ad2064024"}]} {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:50:40.852192 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:50:40.852192 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: warnings.warn(msg) Apr 08 02:50:40.862597 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-14f56a61-f183-4296-a6c7-fcb41d18f7d7 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:40.862838 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-e3b7664c-50f9-4390-8ec6-fcce231c40e7 req-94ee2793-45da-4117-8135-b081d5db0802 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:40.863127 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-e3b7664c-50f9-4390-8ec6-fcce231c40e7 req-94ee2793-45da-4117-8135-b081d5db0802 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:40.870133 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-14f56a61-f183-4296-a6c7-fcb41d18f7d7 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:40.871266 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-14f56a61-f183-4296-a6c7-fcb41d18f7d7 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1797 microversion: 2.20 time: 0.350390 Apr 08 02:50:40.871789 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 258/522] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:50:40 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1797 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 02:50:40.882484 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-19eeff78-0907-4284-9f50-c1fe9d764106 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:40.883254 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-19eeff78-0907-4284-9f50-c1fe9d764106 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] [instance: 2fb4b617-e0c5-4496-858f-f139414f8fb5] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:40.895519 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-19eeff78-0907-4284-9f50-c1fe9d764106 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:40.895768 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.compute.server_external_events [req-e3b7664c-50f9-4390-8ec6-fcce231c40e7 req-94ee2793-45da-4117-8135-b081d5db0802 service nova] Creating event network-changed:1be6ca01-4620-4592-8649-c93ad2064024 for instance 2fb4b617-e0c5-4496-858f-f139414f8fb5 on hv-cinder-83705 Apr 08 02:50:40.896351 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-19eeff78-0907-4284-9f50-c1fe9d764106 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:40.897220 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-19eeff78-0907-4284-9f50-c1fe9d764106 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:40.898181 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-19eeff78-0907-4284-9f50-c1fe9d764106 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:40.902385 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [req-e3b7664c-50f9-4390-8ec6-fcce231c40e7 req-94ee2793-45da-4117-8135-b081d5db0802 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072010 Apr 08 02:50:40.903558 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 265/523] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:50:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:50:40.914385 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-b8f3da0a-4758-43f2-ab0f-a53a983b8477 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:40.916132 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-b8f3da0a-4758-43f2-ab0f-a53a983b8477 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 1b72863f-5373-4ef6-b303-1b7955cafa96] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:40.926116 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b8f3da0a-4758-43f2-ab0f-a53a983b8477 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:40.926559 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b8f3da0a-4758-43f2-ab0f-a53a983b8477 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:40.927364 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b8f3da0a-4758-43f2-ab0f-a53a983b8477 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:40.928007 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b8f3da0a-4758-43f2-ab0f-a53a983b8477 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:41.224390 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-19eeff78-0907-4284-9f50-c1fe9d764106 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86a950d41cc44fb9f10b600b20b0ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f311117084470f8e8d16c47ad1d2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:41.232439 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-b8f3da0a-4758-43f2-ab0f-a53a983b8477 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:41.233861 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-19eeff78-0907-4284-9f50-c1fe9d764106 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] 10.222.0.48 "GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5" status: 200 len: 1260 microversion: 2.1 time: 0.360758 Apr 08 02:50:41.234414 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 259/524] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:40 2022] GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5 => generated 1260 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:50:41.241517 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-b8f3da0a-4758-43f2-ab0f-a53a983b8477 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96" status: 200 len: 1732 microversion: 2.1 time: 0.336513 Apr 08 02:50:41.242046 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 266/525] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:40 2022] GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96 => generated 1732 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:50:42.260396 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-c6b1fd79-5bd0-4ade-8035-aa6dedbda16f tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:42.261200 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-c6b1fd79-5bd0-4ade-8035-aa6dedbda16f tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] [instance: 2fb4b617-e0c5-4496-858f-f139414f8fb5] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:42.265033 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-b5cede47-bc07-4bad-87a3-39555fac85e3 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:42.265643 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-b5cede47-bc07-4bad-87a3-39555fac85e3 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 1b72863f-5373-4ef6-b303-1b7955cafa96] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:42.269386 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-c6b1fd79-5bd0-4ade-8035-aa6dedbda16f tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:42.269947 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-c6b1fd79-5bd0-4ade-8035-aa6dedbda16f tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:42.271000 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-c6b1fd79-5bd0-4ade-8035-aa6dedbda16f tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:42.271527 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-c6b1fd79-5bd0-4ade-8035-aa6dedbda16f tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:42.272871 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b5cede47-bc07-4bad-87a3-39555fac85e3 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:42.273321 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b5cede47-bc07-4bad-87a3-39555fac85e3 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:42.274094 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b5cede47-bc07-4bad-87a3-39555fac85e3 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:42.275541 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b5cede47-bc07-4bad-87a3-39555fac85e3 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:42.568357 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-c6b1fd79-5bd0-4ade-8035-aa6dedbda16f tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86a950d41cc44fb9f10b600b20b0ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f311117084470f8e8d16c47ad1d2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:42.575091 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-b5cede47-bc07-4bad-87a3-39555fac85e3 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:42.577441 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-c6b1fd79-5bd0-4ade-8035-aa6dedbda16f tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] 10.222.0.48 "GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5" status: 200 len: 1260 microversion: 2.1 time: 0.327114 Apr 08 02:50:42.578216 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 260/526] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:42 2022] GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5 => generated 1260 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:50:42.584163 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-b5cede47-bc07-4bad-87a3-39555fac85e3 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96" status: 200 len: 1732 microversion: 2.1 time: 0.329070 Apr 08 02:50:42.584840 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 267/527] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:42 2022] GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96 => generated 1732 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:50:43.599989 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-4ced709c-924d-4922-8642-8f77de07e845 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:43.600599 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-4ced709c-924d-4922-8642-8f77de07e845 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] [instance: 2fb4b617-e0c5-4496-858f-f139414f8fb5] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:43.608550 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-4ced709c-924d-4922-8642-8f77de07e845 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:43.608726 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-401549fb-3a7c-4d22-9e6b-d77473a2af58 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:43.609167 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-4ced709c-924d-4922-8642-8f77de07e845 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:43.609267 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-401549fb-3a7c-4d22-9e6b-d77473a2af58 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 1b72863f-5373-4ef6-b303-1b7955cafa96] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:43.609745 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-4ced709c-924d-4922-8642-8f77de07e845 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:43.610170 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-4ced709c-924d-4922-8642-8f77de07e845 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:43.616362 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-401549fb-3a7c-4d22-9e6b-d77473a2af58 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:43.616800 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-401549fb-3a7c-4d22-9e6b-d77473a2af58 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:43.617566 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-401549fb-3a7c-4d22-9e6b-d77473a2af58 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:43.617997 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-401549fb-3a7c-4d22-9e6b-d77473a2af58 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:43.910798 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-4ced709c-924d-4922-8642-8f77de07e845 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86a950d41cc44fb9f10b600b20b0ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f311117084470f8e8d16c47ad1d2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:43.916304 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-401549fb-3a7c-4d22-9e6b-d77473a2af58 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:43.919940 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-4ced709c-924d-4922-8642-8f77de07e845 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] 10.222.0.48 "GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5" status: 200 len: 1260 microversion: 2.1 time: 0.328894 Apr 08 02:50:43.920563 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 261/528] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:43 2022] GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5 => generated 1260 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:50:43.930047 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-401549fb-3a7c-4d22-9e6b-d77473a2af58 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96" status: 200 len: 1732 microversion: 2.1 time: 0.331959 Apr 08 02:50:43.930606 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 268/529] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:43 2022] GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96 => generated 1732 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:50:44.943101 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-1bcfa9aa-1718-4e87-b4ba-ded0564f754e tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:44.943721 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-1bcfa9aa-1718-4e87-b4ba-ded0564f754e tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] [instance: 2fb4b617-e0c5-4496-858f-f139414f8fb5] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:44.952134 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-1bcfa9aa-1718-4e87-b4ba-ded0564f754e tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:44.952459 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-136746d3-ed7a-498f-a28a-ea01a2f812cd tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:44.953220 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-1bcfa9aa-1718-4e87-b4ba-ded0564f754e tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:44.953557 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-136746d3-ed7a-498f-a28a-ea01a2f812cd tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 1b72863f-5373-4ef6-b303-1b7955cafa96] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:44.954136 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-1bcfa9aa-1718-4e87-b4ba-ded0564f754e tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:44.954631 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-1bcfa9aa-1718-4e87-b4ba-ded0564f754e tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:44.960762 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-136746d3-ed7a-498f-a28a-ea01a2f812cd tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:44.961199 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-136746d3-ed7a-498f-a28a-ea01a2f812cd tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:44.962508 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-136746d3-ed7a-498f-a28a-ea01a2f812cd tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:44.963132 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-136746d3-ed7a-498f-a28a-ea01a2f812cd tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:45.255524 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-1bcfa9aa-1718-4e87-b4ba-ded0564f754e tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86a950d41cc44fb9f10b600b20b0ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f311117084470f8e8d16c47ad1d2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:45.263078 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-136746d3-ed7a-498f-a28a-ea01a2f812cd tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:45.265048 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-1bcfa9aa-1718-4e87-b4ba-ded0564f754e tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] 10.222.0.48 "GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5" status: 200 len: 1260 microversion: 2.1 time: 0.331786 Apr 08 02:50:45.265756 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 262/530] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:44 2022] GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5 => generated 1260 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:50:45.278644 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-136746d3-ed7a-498f-a28a-ea01a2f812cd tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96" status: 200 len: 1732 microversion: 2.1 time: 0.335445 Apr 08 02:50:45.279207 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 269/531] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:44 2022] GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96 => generated 1732 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:50:46.286737 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-7eedd5ab-3f2a-4c28-a94b-1ff90bfbf6a4 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:46.287281 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-7eedd5ab-3f2a-4c28-a94b-1ff90bfbf6a4 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] [instance: 2fb4b617-e0c5-4496-858f-f139414f8fb5] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:46.295305 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-7eedd5ab-3f2a-4c28-a94b-1ff90bfbf6a4 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:46.295743 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-7eedd5ab-3f2a-4c28-a94b-1ff90bfbf6a4 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:46.296496 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-7eedd5ab-3f2a-4c28-a94b-1ff90bfbf6a4 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:46.296925 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-7eedd5ab-3f2a-4c28-a94b-1ff90bfbf6a4 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:46.302938 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-b9ee154b-3c97-4c05-bd78-33583efd9740 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:46.303489 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-b9ee154b-3c97-4c05-bd78-33583efd9740 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 1b72863f-5373-4ef6-b303-1b7955cafa96] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:46.310636 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b9ee154b-3c97-4c05-bd78-33583efd9740 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:46.311124 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b9ee154b-3c97-4c05-bd78-33583efd9740 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:46.311897 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b9ee154b-3c97-4c05-bd78-33583efd9740 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:46.312326 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b9ee154b-3c97-4c05-bd78-33583efd9740 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:46.651417 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-7eedd5ab-3f2a-4c28-a94b-1ff90bfbf6a4 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86a950d41cc44fb9f10b600b20b0ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f311117084470f8e8d16c47ad1d2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:46.656001 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-b9ee154b-3c97-4c05-bd78-33583efd9740 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:46.659596 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-7eedd5ab-3f2a-4c28-a94b-1ff90bfbf6a4 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] 10.222.0.48 "GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5" status: 200 len: 1260 microversion: 2.1 time: 0.381788 Apr 08 02:50:46.662805 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 263/532] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:46 2022] GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5 => generated 1260 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:50:46.670494 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-b9ee154b-3c97-4c05-bd78-33583efd9740 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96" status: 200 len: 1732 microversion: 2.1 time: 0.377577 Apr 08 02:50:46.671210 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 270/533] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:46 2022] GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96 => generated 1732 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:50:47.681708 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-7b61b22f-ef97-4ddc-bb9c-222cb78e6bbe tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:47.682286 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-7b61b22f-ef97-4ddc-bb9c-222cb78e6bbe tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] [instance: 2fb4b617-e0c5-4496-858f-f139414f8fb5] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:47.689394 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-7b61b22f-ef97-4ddc-bb9c-222cb78e6bbe tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:47.689837 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-7b61b22f-ef97-4ddc-bb9c-222cb78e6bbe tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:47.690602 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-7b61b22f-ef97-4ddc-bb9c-222cb78e6bbe tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:47.691056 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-7b61b22f-ef97-4ddc-bb9c-222cb78e6bbe tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:47.692555 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-f8d7ed0a-ccb8-4944-a8b4-7d2cd0470c63 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:47.693146 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-f8d7ed0a-ccb8-4944-a8b4-7d2cd0470c63 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 1b72863f-5373-4ef6-b303-1b7955cafa96] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:47.700276 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-f8d7ed0a-ccb8-4944-a8b4-7d2cd0470c63 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:47.700712 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-f8d7ed0a-ccb8-4944-a8b4-7d2cd0470c63 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:47.701470 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-f8d7ed0a-ccb8-4944-a8b4-7d2cd0470c63 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:47.701889 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-f8d7ed0a-ccb8-4944-a8b4-7d2cd0470c63 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:47.999901 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-7b61b22f-ef97-4ddc-bb9c-222cb78e6bbe tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86a950d41cc44fb9f10b600b20b0ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f311117084470f8e8d16c47ad1d2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:48.007192 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-f8d7ed0a-ccb8-4944-a8b4-7d2cd0470c63 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:48.010023 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-7b61b22f-ef97-4ddc-bb9c-222cb78e6bbe tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] 10.222.0.48 "GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5" status: 200 len: 1260 microversion: 2.1 time: 0.337454 Apr 08 02:50:48.019355 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 264/534] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:47 2022] GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5 => generated 1260 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:50:48.019545 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-f8d7ed0a-ccb8-4944-a8b4-7d2cd0470c63 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96" status: 200 len: 1732 microversion: 2.1 time: 0.334772 Apr 08 02:50:48.019545 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 271/535] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:47 2022] GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96 => generated 1732 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:50:49.033179 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-88135725-6845-4bba-9808-ece35e38b7cb tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:49.033780 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-88135725-6845-4bba-9808-ece35e38b7cb tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] [instance: 2fb4b617-e0c5-4496-858f-f139414f8fb5] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:49.039743 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-694023f8-a76d-4e77-bdf2-e7303b234a08 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:49.040622 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-694023f8-a76d-4e77-bdf2-e7303b234a08 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 1b72863f-5373-4ef6-b303-1b7955cafa96] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:49.041781 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-88135725-6845-4bba-9808-ece35e38b7cb tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:49.042228 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-88135725-6845-4bba-9808-ece35e38b7cb tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:49.043294 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-88135725-6845-4bba-9808-ece35e38b7cb tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:49.043808 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-88135725-6845-4bba-9808-ece35e38b7cb tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:49.047656 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-694023f8-a76d-4e77-bdf2-e7303b234a08 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:49.048096 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-694023f8-a76d-4e77-bdf2-e7303b234a08 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:49.048867 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-694023f8-a76d-4e77-bdf2-e7303b234a08 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:49.049291 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-694023f8-a76d-4e77-bdf2-e7303b234a08 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:49.487584 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-88135725-6845-4bba-9808-ece35e38b7cb tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86a950d41cc44fb9f10b600b20b0ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f311117084470f8e8d16c47ad1d2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:49.496163 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-88135725-6845-4bba-9808-ece35e38b7cb tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] 10.222.0.48 "GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5" status: 200 len: 1260 microversion: 2.1 time: 0.472508 Apr 08 02:50:49.496703 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 265/536] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:49 2022] GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5 => generated 1260 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:50:49.556156 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-694023f8-a76d-4e77-bdf2-e7303b234a08 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:49.564749 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-694023f8-a76d-4e77-bdf2-e7303b234a08 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96" status: 200 len: 1732 microversion: 2.1 time: 0.534261 Apr 08 02:50:49.565485 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 272/537] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:49 2022] GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96 => generated 1732 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:50:50.519164 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-6c1f94b1-01d0-4d3a-ac9a-94360ffbf607 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:50.519763 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-6c1f94b1-01d0-4d3a-ac9a-94360ffbf607 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] [instance: 2fb4b617-e0c5-4496-858f-f139414f8fb5] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:50.527610 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-6c1f94b1-01d0-4d3a-ac9a-94360ffbf607 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:50.528053 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-6c1f94b1-01d0-4d3a-ac9a-94360ffbf607 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:50.529015 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-6c1f94b1-01d0-4d3a-ac9a-94360ffbf607 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:50.529567 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-6c1f94b1-01d0-4d3a-ac9a-94360ffbf607 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:50.586304 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-10fe3bc9-363f-478b-b982-e6c2b12893f4 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:50.587009 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-10fe3bc9-363f-478b-b982-e6c2b12893f4 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 1b72863f-5373-4ef6-b303-1b7955cafa96] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:50.594139 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-10fe3bc9-363f-478b-b982-e6c2b12893f4 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:50.594646 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-10fe3bc9-363f-478b-b982-e6c2b12893f4 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:50.595491 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-10fe3bc9-363f-478b-b982-e6c2b12893f4 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:50.595975 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-10fe3bc9-363f-478b-b982-e6c2b12893f4 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:50.785030 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-6c1f94b1-01d0-4d3a-ac9a-94360ffbf607 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86a950d41cc44fb9f10b600b20b0ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f311117084470f8e8d16c47ad1d2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:50.794436 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-6c1f94b1-01d0-4d3a-ac9a-94360ffbf607 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] 10.222.0.48 "GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5" status: 200 len: 1260 microversion: 2.1 time: 0.284777 Apr 08 02:50:50.795361 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 266/538] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:50 2022] GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5 => generated 1260 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:50:50.848278 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-10fe3bc9-363f-478b-b982-e6c2b12893f4 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:50.858462 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-10fe3bc9-363f-478b-b982-e6c2b12893f4 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96" status: 200 len: 1732 microversion: 2.1 time: 0.280915 Apr 08 02:50:50.859148 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 273/539] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:50 2022] GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96 => generated 1732 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:50:51.816747 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-00d93fbb-7e65-4329-9ff7-df1e0f5272c9 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:51.817356 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-00d93fbb-7e65-4329-9ff7-df1e0f5272c9 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] [instance: 2fb4b617-e0c5-4496-858f-f139414f8fb5] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:51.824381 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-00d93fbb-7e65-4329-9ff7-df1e0f5272c9 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:51.824824 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-00d93fbb-7e65-4329-9ff7-df1e0f5272c9 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:51.825583 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-00d93fbb-7e65-4329-9ff7-df1e0f5272c9 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:51.826004 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-00d93fbb-7e65-4329-9ff7-df1e0f5272c9 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:51.882947 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-8d9d6066-5667-4f22-b4fd-58cca08acce2 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:51.883867 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-8d9d6066-5667-4f22-b4fd-58cca08acce2 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 1b72863f-5373-4ef6-b303-1b7955cafa96] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:51.893155 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-8d9d6066-5667-4f22-b4fd-58cca08acce2 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:51.894029 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-8d9d6066-5667-4f22-b4fd-58cca08acce2 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:51.895180 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-8d9d6066-5667-4f22-b4fd-58cca08acce2 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:51.895768 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-8d9d6066-5667-4f22-b4fd-58cca08acce2 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:52.111256 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-00d93fbb-7e65-4329-9ff7-df1e0f5272c9 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86a950d41cc44fb9f10b600b20b0ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f311117084470f8e8d16c47ad1d2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:52.120462 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-00d93fbb-7e65-4329-9ff7-df1e0f5272c9 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] 10.222.0.48 "GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5" status: 200 len: 1260 microversion: 2.1 time: 0.312694 Apr 08 02:50:52.120999 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 267/540] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:51 2022] GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5 => generated 1260 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:50:52.173804 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-8d9d6066-5667-4f22-b4fd-58cca08acce2 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:52.182610 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-8d9d6066-5667-4f22-b4fd-58cca08acce2 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96" status: 200 len: 1732 microversion: 2.1 time: 0.311351 Apr 08 02:50:52.183174 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 274/541] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:51 2022] GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96 => generated 1732 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:50:53.143075 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-b5cc2139-0e97-4fdb-b35e-842cbf968d23 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:53.144272 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-b5cc2139-0e97-4fdb-b35e-842cbf968d23 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] [instance: 2fb4b617-e0c5-4496-858f-f139414f8fb5] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:53.152932 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b5cc2139-0e97-4fdb-b35e-842cbf968d23 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:53.153642 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b5cc2139-0e97-4fdb-b35e-842cbf968d23 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:53.154432 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b5cc2139-0e97-4fdb-b35e-842cbf968d23 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:53.155021 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b5cc2139-0e97-4fdb-b35e-842cbf968d23 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:53.205363 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-fde59dc3-736e-4554-880e-4623988543fb tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:53.207175 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-fde59dc3-736e-4554-880e-4623988543fb tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 1b72863f-5373-4ef6-b303-1b7955cafa96] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:53.220707 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-fde59dc3-736e-4554-880e-4623988543fb tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:53.221158 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-fde59dc3-736e-4554-880e-4623988543fb tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:53.221941 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-fde59dc3-736e-4554-880e-4623988543fb tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:53.222376 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-fde59dc3-736e-4554-880e-4623988543fb tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:53.472937 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-b5cc2139-0e97-4fdb-b35e-842cbf968d23 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86a950d41cc44fb9f10b600b20b0ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f311117084470f8e8d16c47ad1d2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:53.484834 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-b5cc2139-0e97-4fdb-b35e-842cbf968d23 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] 10.222.0.48 "GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5" status: 200 len: 1260 microversion: 2.1 time: 0.351537 Apr 08 02:50:53.485385 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 268/542] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:53 2022] GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5 => generated 1260 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:50:53.558708 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-fde59dc3-736e-4554-880e-4623988543fb tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:53.568910 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-fde59dc3-736e-4554-880e-4623988543fb tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96" status: 200 len: 1732 microversion: 2.1 time: 0.373019 Apr 08 02:50:53.569551 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 275/543] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:53 2022] GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96 => generated 1732 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:50:53.869332 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [req-13d74cba-9252-4722-8eaf-c3de81a95aa8 req-d0efa4fb-715a-4fa7-bc7c-509a2b49513a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fb4b617-e0c5-4496-858f-f139414f8fb5", "name": "network-vif-plugged", "status": "completed", "tag": "1be6ca01-4620-4592-8649-c93ad2064024"}]} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:50:53.891246 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:50:53.891246 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: warnings.warn(msg) Apr 08 02:50:53.909545 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-13d74cba-9252-4722-8eaf-c3de81a95aa8 req-d0efa4fb-715a-4fa7-bc7c-509a2b49513a service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:53.910254 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-13d74cba-9252-4722-8eaf-c3de81a95aa8 req-d0efa4fb-715a-4fa7-bc7c-509a2b49513a service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:53.937353 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.compute.server_external_events [req-13d74cba-9252-4722-8eaf-c3de81a95aa8 req-d0efa4fb-715a-4fa7-bc7c-509a2b49513a service nova] Creating event network-vif-plugged:1be6ca01-4620-4592-8649-c93ad2064024 for instance 2fb4b617-e0c5-4496-858f-f139414f8fb5 on hv-cinder-83705 Apr 08 02:50:53.942653 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [req-13d74cba-9252-4722-8eaf-c3de81a95aa8 req-d0efa4fb-715a-4fa7-bc7c-509a2b49513a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094218 Apr 08 02:50:53.943838 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 269/544] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:50:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:50:54.507814 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-1adddac7-edfc-44a9-8a2b-e46b42ded15c tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:54.509821 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-1adddac7-edfc-44a9-8a2b-e46b42ded15c tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] [instance: 2fb4b617-e0c5-4496-858f-f139414f8fb5] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:54.518163 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-1adddac7-edfc-44a9-8a2b-e46b42ded15c tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:54.518885 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-1adddac7-edfc-44a9-8a2b-e46b42ded15c tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:54.519726 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-1adddac7-edfc-44a9-8a2b-e46b42ded15c tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:54.520394 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-1adddac7-edfc-44a9-8a2b-e46b42ded15c tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:54.609517 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-60594a42-b59d-4e4c-b2aa-c32bd49fddbc tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:54.612563 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-60594a42-b59d-4e4c-b2aa-c32bd49fddbc tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 1b72863f-5373-4ef6-b303-1b7955cafa96] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:54.638182 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-60594a42-b59d-4e4c-b2aa-c32bd49fddbc tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:54.641702 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-60594a42-b59d-4e4c-b2aa-c32bd49fddbc tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:54.643277 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-60594a42-b59d-4e4c-b2aa-c32bd49fddbc tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:54.650383 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-60594a42-b59d-4e4c-b2aa-c32bd49fddbc tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:54.906075 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-1adddac7-edfc-44a9-8a2b-e46b42ded15c tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86a950d41cc44fb9f10b600b20b0ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f311117084470f8e8d16c47ad1d2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:54.927716 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-1adddac7-edfc-44a9-8a2b-e46b42ded15c tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] 10.222.0.48 "GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5" status: 200 len: 1260 microversion: 2.1 time: 0.428916 Apr 08 02:50:54.928488 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 276/545] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:54 2022] GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5 => generated 1260 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:50:55.011554 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-60594a42-b59d-4e4c-b2aa-c32bd49fddbc tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:55.025058 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-60594a42-b59d-4e4c-b2aa-c32bd49fddbc tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96" status: 200 len: 1732 microversion: 2.1 time: 0.441832 Apr 08 02:50:55.026303 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 270/546] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:54 2022] GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96 => generated 1732 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:50:55.950469 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-660582f4-bc23-49fc-9229-5d02e02fe1f8 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:55.951872 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-660582f4-bc23-49fc-9229-5d02e02fe1f8 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] [instance: 2fb4b617-e0c5-4496-858f-f139414f8fb5] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:55.959549 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-660582f4-bc23-49fc-9229-5d02e02fe1f8 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:55.960302 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-660582f4-bc23-49fc-9229-5d02e02fe1f8 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:55.963351 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-660582f4-bc23-49fc-9229-5d02e02fe1f8 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:55.964029 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-660582f4-bc23-49fc-9229-5d02e02fe1f8 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:56.052404 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-5e315ae9-0a5e-49b1-8593-6fd4db36e9b2 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:56.055017 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-5e315ae9-0a5e-49b1-8593-6fd4db36e9b2 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 1b72863f-5373-4ef6-b303-1b7955cafa96] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:56.063836 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-5e315ae9-0a5e-49b1-8593-6fd4db36e9b2 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:56.064601 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-5e315ae9-0a5e-49b1-8593-6fd4db36e9b2 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:56.065626 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-5e315ae9-0a5e-49b1-8593-6fd4db36e9b2 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:56.066122 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-5e315ae9-0a5e-49b1-8593-6fd4db36e9b2 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:56.429847 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-660582f4-bc23-49fc-9229-5d02e02fe1f8 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86a950d41cc44fb9f10b600b20b0ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f311117084470f8e8d16c47ad1d2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:56.431970 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-5e315ae9-0a5e-49b1-8593-6fd4db36e9b2 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:56.442432 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-5e315ae9-0a5e-49b1-8593-6fd4db36e9b2 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96" status: 200 len: 1732 microversion: 2.1 time: 0.403738 Apr 08 02:50:56.444596 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 271/547] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:56 2022] GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96 => generated 1732 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:50:56.449638 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-660582f4-bc23-49fc-9229-5d02e02fe1f8 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] 10.222.0.48 "GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5" status: 200 len: 1260 microversion: 2.1 time: 0.509430 Apr 08 02:50:56.460015 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 277/548] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:55 2022] GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5 => generated 1260 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:50:57.468708 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-ae947568-6da9-4d79-a0a7-5e8604d5d190 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:57.470433 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-ae947568-6da9-4d79-a0a7-5e8604d5d190 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 1b72863f-5373-4ef6-b303-1b7955cafa96] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:57.477708 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-0e84cb40-d184-4203-8d15-68f66e932e4f tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:57.481152 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-0e84cb40-d184-4203-8d15-68f66e932e4f tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] [instance: 2fb4b617-e0c5-4496-858f-f139414f8fb5] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:57.487293 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ae947568-6da9-4d79-a0a7-5e8604d5d190 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:57.487736 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ae947568-6da9-4d79-a0a7-5e8604d5d190 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:57.488509 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ae947568-6da9-4d79-a0a7-5e8604d5d190 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:57.488938 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ae947568-6da9-4d79-a0a7-5e8604d5d190 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:57.491850 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-0e84cb40-d184-4203-8d15-68f66e932e4f tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:57.492755 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-0e84cb40-d184-4203-8d15-68f66e932e4f tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:57.493582 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-0e84cb40-d184-4203-8d15-68f66e932e4f tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:57.494091 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-0e84cb40-d184-4203-8d15-68f66e932e4f tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:57.812170 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-ae947568-6da9-4d79-a0a7-5e8604d5d190 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:57.816095 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-0e84cb40-d184-4203-8d15-68f66e932e4f tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86a950d41cc44fb9f10b600b20b0ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f311117084470f8e8d16c47ad1d2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:57.821902 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-ae947568-6da9-4d79-a0a7-5e8604d5d190 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96" status: 200 len: 1732 microversion: 2.1 time: 0.364707 Apr 08 02:50:57.822526 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 272/549] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:57 2022] GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96 => generated 1732 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:50:57.828910 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-0e84cb40-d184-4203-8d15-68f66e932e4f tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] 10.222.0.48 "GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5" status: 200 len: 1444 microversion: 2.1 time: 0.365526 Apr 08 02:50:57.829638 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 278/550] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:57 2022] GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5 => generated 1444 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:50:57.851593 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-c50baeb4-dadc-4d07-9cdd-45860d3b9b09 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:57.852772 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-c50baeb4-dadc-4d07-9cdd-45860d3b9b09 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] [instance: 2fb4b617-e0c5-4496-858f-f139414f8fb5] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:57.860065 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-c50baeb4-dadc-4d07-9cdd-45860d3b9b09 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:57.860391 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-c50baeb4-dadc-4d07-9cdd-45860d3b9b09 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:57.861196 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-c50baeb4-dadc-4d07-9cdd-45860d3b9b09 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:57.861627 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-c50baeb4-dadc-4d07-9cdd-45860d3b9b09 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:58.071228 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-c50baeb4-dadc-4d07-9cdd-45860d3b9b09 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86a950d41cc44fb9f10b600b20b0ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f311117084470f8e8d16c47ad1d2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:58.079409 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-c50baeb4-dadc-4d07-9cdd-45860d3b9b09 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] 10.222.0.48 "GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5" status: 200 len: 1444 microversion: 2.1 time: 0.236933 Apr 08 02:50:58.079954 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 273/551] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:57 2022] GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5 => generated 1444 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:50:58.850137 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-e6032d01-a9d2-4896-b6b9-5149f0e72cdb tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:50:58.850964 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-e6032d01-a9d2-4896-b6b9-5149f0e72cdb tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 1b72863f-5373-4ef6-b303-1b7955cafa96] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:50:58.859992 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-e6032d01-a9d2-4896-b6b9-5149f0e72cdb tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:58.860763 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-e6032d01-a9d2-4896-b6b9-5149f0e72cdb tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:58.861762 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-e6032d01-a9d2-4896-b6b9-5149f0e72cdb tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:50:58.862394 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-e6032d01-a9d2-4896-b6b9-5149f0e72cdb tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:50:59.310951 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-e6032d01-a9d2-4896-b6b9-5149f0e72cdb tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:50:59.329869 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-e6032d01-a9d2-4896-b6b9-5149f0e72cdb tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96" status: 200 len: 1732 microversion: 2.1 time: 0.494360 Apr 08 02:50:59.331164 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 279/552] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:50:58 2022] GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96 => generated 1732 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:51:00.360006 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-977badb4-8739-4f24-bd7f-63380eeed72b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:00.360509 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-977badb4-8739-4f24-bd7f-63380eeed72b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 1b72863f-5373-4ef6-b303-1b7955cafa96] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:51:00.377446 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-977badb4-8739-4f24-bd7f-63380eeed72b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:00.377892 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-977badb4-8739-4f24-bd7f-63380eeed72b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:00.378694 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-977badb4-8739-4f24-bd7f-63380eeed72b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:00.382761 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-977badb4-8739-4f24-bd7f-63380eeed72b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:00.791756 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-977badb4-8739-4f24-bd7f-63380eeed72b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:51:00.814846 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-977badb4-8739-4f24-bd7f-63380eeed72b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96" status: 200 len: 1732 microversion: 2.1 time: 0.470501 Apr 08 02:51:00.816040 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 274/553] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:00 2022] GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96 => generated 1732 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:51:01.845183 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-b94a3692-b465-424b-84b5-44cd8c5f5cbe tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:01.846402 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-b94a3692-b465-424b-84b5-44cd8c5f5cbe tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 1b72863f-5373-4ef6-b303-1b7955cafa96] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:51:01.864770 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b94a3692-b465-424b-84b5-44cd8c5f5cbe tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:01.865534 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b94a3692-b465-424b-84b5-44cd8c5f5cbe tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:01.867859 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b94a3692-b465-424b-84b5-44cd8c5f5cbe tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:01.868403 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b94a3692-b465-424b-84b5-44cd8c5f5cbe tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:02.360401 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-b94a3692-b465-424b-84b5-44cd8c5f5cbe tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:51:02.380276 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-b94a3692-b465-424b-84b5-44cd8c5f5cbe tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96" status: 200 len: 1712 microversion: 2.1 time: 0.550724 Apr 08 02:51:02.380994 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 280/554] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:01 2022] GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96 => generated 1712 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:51:02.545953 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-bc0f6963-6601-46a1-9dae-22451c9c3bb8 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:02.547326 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-bc0f6963-6601-46a1-9dae-22451c9c3bb8 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 1b72863f-5373-4ef6-b303-1b7955cafa96] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:51:02.558620 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-bc0f6963-6601-46a1-9dae-22451c9c3bb8 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:02.559449 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-bc0f6963-6601-46a1-9dae-22451c9c3bb8 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:02.561335 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-bc0f6963-6601-46a1-9dae-22451c9c3bb8 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:02.562576 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-bc0f6963-6601-46a1-9dae-22451c9c3bb8 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:02.635236 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [req-417224c1-13dd-4ba1-a1a5-bf0fbe9ef33d req-c738a852-2e6b-41c0-8a74-0354f9a53ebc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fb4b617-e0c5-4496-858f-f139414f8fb5", "tag": "1be6ca01-4620-4592-8649-c93ad2064024"}]} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:51:02.647074 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:51:02.647074 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: warnings.warn(msg) Apr 08 02:51:02.673746 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-417224c1-13dd-4ba1-a1a5-bf0fbe9ef33d req-c738a852-2e6b-41c0-8a74-0354f9a53ebc service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:02.674448 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-417224c1-13dd-4ba1-a1a5-bf0fbe9ef33d req-c738a852-2e6b-41c0-8a74-0354f9a53ebc service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:02.708039 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.compute.server_external_events [req-417224c1-13dd-4ba1-a1a5-bf0fbe9ef33d req-c738a852-2e6b-41c0-8a74-0354f9a53ebc service nova] Creating event network-changed:1be6ca01-4620-4592-8649-c93ad2064024 for instance 2fb4b617-e0c5-4496-858f-f139414f8fb5 on hv-cinder-83705 Apr 08 02:51:02.723568 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [req-417224c1-13dd-4ba1-a1a5-bf0fbe9ef33d req-c738a852-2e6b-41c0-8a74-0354f9a53ebc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.348793 Apr 08 02:51:02.724167 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 275/555] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:51:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 02:51:02.749818 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.wsgi [None req-bc0f6963-6601-46a1-9dae-22451c9c3bb8 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] HTTP exception thrown: Cannot 'detach_volume' instance 1b72863f-5373-4ef6-b303-1b7955cafa96 while it is in vm_state rescued Apr 08 02:51:02.750405 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-bc0f6963-6601-46a1-9dae-22451c9c3bb8 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Returning 409 to user: Cannot 'detach_volume' instance 1b72863f-5373-4ef6-b303-1b7955cafa96 while it is in vm_state rescued {{(pid=96920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Apr 08 02:51:02.751238 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-bc0f6963-6601-46a1-9dae-22451c9c3bb8 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "DELETE /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96/os-volume_attachments/ed472012-97bc-4464-95ac-915df5116649" status: 409 len: 152 microversion: 2.1 time: 0.217856 Apr 08 02:51:02.752291 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 281/556] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Apr 8 02:51:02 2022] DELETE /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96/os-volume_attachments/ed472012-97bc-4464-95ac-915df5116649 => generated 152 bytes in 219 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 08 02:51:02.766758 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-68435b09-989e-436a-baf9-752dce611c8b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:51:02.767697 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-68435b09-989e-436a-baf9-752dce611c8b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 1b72863f-5373-4ef6-b303-1b7955cafa96] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:51:02.776691 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-68435b09-989e-436a-baf9-752dce611c8b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:02.777409 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-68435b09-989e-436a-baf9-752dce611c8b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:02.778438 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-68435b09-989e-436a-baf9-752dce611c8b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:02.779379 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-68435b09-989e-436a-baf9-752dce611c8b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:02.938825 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-68435b09-989e-436a-baf9-752dce611c8b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "POST /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96/action" status: 202 len: 0 microversion: 2.1 time: 0.181440 Apr 08 02:51:02.944068 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 276/557] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Apr 8 02:51:02 2022] POST /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 02:51:02.953793 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-c71d8cc8-8691-42a4-a6f7-efb8562dda23 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:02.958411 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-c71d8cc8-8691-42a4-a6f7-efb8562dda23 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 1b72863f-5373-4ef6-b303-1b7955cafa96] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:51:02.976508 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c71d8cc8-8691-42a4-a6f7-efb8562dda23 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:02.979618 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c71d8cc8-8691-42a4-a6f7-efb8562dda23 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:02.980649 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c71d8cc8-8691-42a4-a6f7-efb8562dda23 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:02.985621 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c71d8cc8-8691-42a4-a6f7-efb8562dda23 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:03.299981 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-c71d8cc8-8691-42a4-a6f7-efb8562dda23 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:51:03.314595 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-c71d8cc8-8691-42a4-a6f7-efb8562dda23 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96" status: 200 len: 1720 microversion: 2.1 time: 0.369968 Apr 08 02:51:03.315332 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 282/558] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:02 2022] GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96 => generated 1720 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:51:04.349173 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-e4ef44c8-4e7c-40e9-bc4b-6bf00645091b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:04.349980 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-e4ef44c8-4e7c-40e9-bc4b-6bf00645091b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 1b72863f-5373-4ef6-b303-1b7955cafa96] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:51:04.358908 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-e4ef44c8-4e7c-40e9-bc4b-6bf00645091b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:04.359352 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-e4ef44c8-4e7c-40e9-bc4b-6bf00645091b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:04.360136 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-e4ef44c8-4e7c-40e9-bc4b-6bf00645091b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:04.360562 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-e4ef44c8-4e7c-40e9-bc4b-6bf00645091b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:04.787456 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-e4ef44c8-4e7c-40e9-bc4b-6bf00645091b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:51:04.808976 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-e4ef44c8-4e7c-40e9-bc4b-6bf00645091b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96" status: 200 len: 1720 microversion: 2.1 time: 0.479331 Apr 08 02:51:04.818399 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 277/559] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:04 2022] GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96 => generated 1720 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:51:05.831283 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-a7992c19-739c-49ff-b6b8-b0aab1a624e9 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:05.832559 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-a7992c19-739c-49ff-b6b8-b0aab1a624e9 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 1b72863f-5373-4ef6-b303-1b7955cafa96] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:51:05.840582 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-a7992c19-739c-49ff-b6b8-b0aab1a624e9 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:05.841449 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-a7992c19-739c-49ff-b6b8-b0aab1a624e9 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:05.842302 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-a7992c19-739c-49ff-b6b8-b0aab1a624e9 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:05.842830 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-a7992c19-739c-49ff-b6b8-b0aab1a624e9 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:06.076013 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-a7992c19-739c-49ff-b6b8-b0aab1a624e9 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:51:06.085823 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-a7992c19-739c-49ff-b6b8-b0aab1a624e9 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96" status: 200 len: 1720 microversion: 2.1 time: 0.263657 Apr 08 02:51:06.095402 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 283/560] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:05 2022] GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96 => generated 1720 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:51:07.108433 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-d3519d21-e20d-470d-a771-9f6d5f2757fd tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:07.111111 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-d3519d21-e20d-470d-a771-9f6d5f2757fd tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 1b72863f-5373-4ef6-b303-1b7955cafa96] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:51:07.118650 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-d3519d21-e20d-470d-a771-9f6d5f2757fd tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:07.119340 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-d3519d21-e20d-470d-a771-9f6d5f2757fd tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:07.120120 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-d3519d21-e20d-470d-a771-9f6d5f2757fd tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:07.120551 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-d3519d21-e20d-470d-a771-9f6d5f2757fd tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:07.335070 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-d3519d21-e20d-470d-a771-9f6d5f2757fd tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:51:07.344834 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-d3519d21-e20d-470d-a771-9f6d5f2757fd tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96" status: 200 len: 1720 microversion: 2.1 time: 0.245598 Apr 08 02:51:07.345696 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 278/561] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:07 2022] GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96 => generated 1720 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:51:08.367469 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-b8576be1-eae2-4fa7-96a6-8a9d5ad7a44a tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:08.368734 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-b8576be1-eae2-4fa7-96a6-8a9d5ad7a44a tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 1b72863f-5373-4ef6-b303-1b7955cafa96] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:51:08.376652 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b8576be1-eae2-4fa7-96a6-8a9d5ad7a44a tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:08.377200 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b8576be1-eae2-4fa7-96a6-8a9d5ad7a44a tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:08.378235 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b8576be1-eae2-4fa7-96a6-8a9d5ad7a44a tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:08.379098 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b8576be1-eae2-4fa7-96a6-8a9d5ad7a44a tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:08.637014 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-b8576be1-eae2-4fa7-96a6-8a9d5ad7a44a tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:51:08.645866 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-b8576be1-eae2-4fa7-96a6-8a9d5ad7a44a tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96" status: 200 len: 1720 microversion: 2.1 time: 0.287521 Apr 08 02:51:08.646408 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 284/562] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:08 2022] GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96 => generated 1720 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:51:09.668785 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-07df4385-6915-499e-8bcd-f814dd1311ff tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:09.669570 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-07df4385-6915-499e-8bcd-f814dd1311ff tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 1b72863f-5373-4ef6-b303-1b7955cafa96] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:51:09.677076 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-07df4385-6915-499e-8bcd-f814dd1311ff tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:09.677518 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-07df4385-6915-499e-8bcd-f814dd1311ff tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:09.678287 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-07df4385-6915-499e-8bcd-f814dd1311ff tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:09.678736 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-07df4385-6915-499e-8bcd-f814dd1311ff tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:09.889674 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-07df4385-6915-499e-8bcd-f814dd1311ff tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:51:09.898358 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-07df4385-6915-499e-8bcd-f814dd1311ff tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96" status: 200 len: 1726 microversion: 2.1 time: 0.238549 Apr 08 02:51:09.909424 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 279/563] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:09 2022] GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96 => generated 1726 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:51:09.920456 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-2293ee88-f9e6-4c78-b979-cf86024610d4 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:09.921619 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-2293ee88-f9e6-4c78-b979-cf86024610d4 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 1b72863f-5373-4ef6-b303-1b7955cafa96] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:51:09.929157 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-2293ee88-f9e6-4c78-b979-cf86024610d4 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:09.929647 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-2293ee88-f9e6-4c78-b979-cf86024610d4 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:09.931103 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-2293ee88-f9e6-4c78-b979-cf86024610d4 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:09.931750 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-2293ee88-f9e6-4c78-b979-cf86024610d4 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:10.097840 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-2293ee88-f9e6-4c78-b979-cf86024610d4 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.186616 Apr 08 02:51:10.098575 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 285/564] 10.222.0.48 () {58 vars in 1274 bytes} [Fri Apr 8 02:51:09 2022] GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96/os-interface => generated 284 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:51:11.951443 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [req-603b2566-3ef7-4f03-9461-e663f2a53f0b req-a8d0d955-18a7-4197-962e-9c4cf7b0a4a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b72863f-5373-4ef6-b303-1b7955cafa96", "tag": "925ad71f-f0c4-4cad-b48b-9505cac52cd3"}]} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:51:11.973456 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:51:11.973456 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: warnings.warn(msg) Apr 08 02:51:11.982342 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-603b2566-3ef7-4f03-9461-e663f2a53f0b req-a8d0d955-18a7-4197-962e-9c4cf7b0a4a7 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:11.982811 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-603b2566-3ef7-4f03-9461-e663f2a53f0b req-a8d0d955-18a7-4197-962e-9c4cf7b0a4a7 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:12.009511 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.compute.server_external_events [req-603b2566-3ef7-4f03-9461-e663f2a53f0b req-a8d0d955-18a7-4197-962e-9c4cf7b0a4a7 service nova] Creating event network-changed:925ad71f-f0c4-4cad-b48b-9505cac52cd3 for instance 1b72863f-5373-4ef6-b303-1b7955cafa96 on hv-cinder-83705 Apr 08 02:51:12.032389 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [req-603b2566-3ef7-4f03-9461-e663f2a53f0b req-a8d0d955-18a7-4197-962e-9c4cf7b0a4a7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128359 Apr 08 02:51:12.033500 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 280/565] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:51:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:51:14.051456 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [req-e1fa9bfb-9f12-488c-b089-2963861096cd req-80140043-6a6a-4ffd-904f-5824c5339770 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b72863f-5373-4ef6-b303-1b7955cafa96", "tag": "925ad71f-f0c4-4cad-b48b-9505cac52cd3"}]} {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:51:14.058373 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:51:14.058373 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: warnings.warn(msg) Apr 08 02:51:14.067397 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-e1fa9bfb-9f12-488c-b089-2963861096cd req-80140043-6a6a-4ffd-904f-5824c5339770 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:14.067836 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-e1fa9bfb-9f12-488c-b089-2963861096cd req-80140043-6a6a-4ffd-904f-5824c5339770 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:14.084751 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.compute.server_external_events [req-e1fa9bfb-9f12-488c-b089-2963861096cd req-80140043-6a6a-4ffd-904f-5824c5339770 service nova] Creating event network-changed:925ad71f-f0c4-4cad-b48b-9505cac52cd3 for instance 1b72863f-5373-4ef6-b303-1b7955cafa96 on hv-cinder-83705 Apr 08 02:51:14.089845 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [req-e1fa9bfb-9f12-488c-b089-2963861096cd req-80140043-6a6a-4ffd-904f-5824c5339770 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047722 Apr 08 02:51:14.090422 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 286/566] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:51:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:51:15.808218 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-266a027c-40e4-4d81-9cb8-6729a5ae8ee9 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Action: 'create', calling method: .version_select at 0x7f7d4e609820>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-373052060"}} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:51:15.833922 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.quota [None req-266a027c-40e4-4d81-9cb8-6729a5ae8ee9 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Getting quotas for project 6eb5fe9c67d048c5b2097f9a923ac025. Resources: {'key_pairs'} {{(pid=96919) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:51:15.837874 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.quota [None req-266a027c-40e4-4d81-9cb8-6729a5ae8ee9 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Getting quotas for user f5b08a414e0c45ab839107cccb69f179 and project 6eb5fe9c67d048c5b2097f9a923ac025. Resources: {'key_pairs'} {{(pid=96919) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:51:15.985785 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.quota [None req-266a027c-40e4-4d81-9cb8-6729a5ae8ee9 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Getting quotas for project 6eb5fe9c67d048c5b2097f9a923ac025. Resources: {'key_pairs'} {{(pid=96919) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:51:15.989374 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.quota [None req-266a027c-40e4-4d81-9cb8-6729a5ae8ee9 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Getting quotas for user f5b08a414e0c45ab839107cccb69f179 and project 6eb5fe9c67d048c5b2097f9a923ac025. Resources: {'key_pairs'} {{(pid=96919) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:51:16.005592 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-266a027c-40e4-4d81-9cb8-6729a5ae8ee9 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.207129 Apr 08 02:51:16.006170 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 281/567] 10.222.0.48 () {60 vars in 1157 bytes} [Fri Apr 8 02:51:15 2022] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:51:16.062932 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-f0b51989-e80b-4818-b79a-16faa698cf34 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1030009052", "imageRef": "6c764dd8-48e2-46de-93d7-e0b940eaf421", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-373052060", "networks": [{"uuid": "8196b4c0-597d-4eba-9f08-9a87d14a2840"}]}} {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:51:16.129167 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.network.neutron [None req-f0b51989-e80b-4818-b79a-16faa698cf34 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] validate_networks() for [('8196b4c0-597d-4eba-9f08-9a87d14a2840', None, None, None)] {{(pid=96920) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} Apr 08 02:51:16.708355 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.virt.hardware [None req-f0b51989-e80b-4818-b79a-16faa698cf34 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Flavor limits 0:0:0 {{(pid=96920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} Apr 08 02:51:16.708778 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.virt.hardware [None req-f0b51989-e80b-4818-b79a-16faa698cf34 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Image limits 0:0:0 {{(pid=96920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} Apr 08 02:51:16.709252 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.virt.hardware [None req-f0b51989-e80b-4818-b79a-16faa698cf34 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Flavor pref 0:0:0 {{(pid=96920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} Apr 08 02:51:16.709656 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.virt.hardware [None req-f0b51989-e80b-4818-b79a-16faa698cf34 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Image pref 0:0:0 {{(pid=96920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} Apr 08 02:51:16.710065 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.virt.hardware [None req-f0b51989-e80b-4818-b79a-16faa698cf34 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=96920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} Apr 08 02:51:16.719137 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-f0b51989-e80b-4818-b79a-16faa698cf34 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:16.719580 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-f0b51989-e80b-4818-b79a-16faa698cf34 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:16.720384 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-f0b51989-e80b-4818-b79a-16faa698cf34 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:16.720815 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-f0b51989-e80b-4818-b79a-16faa698cf34 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:16.737891 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.quota [None req-f0b51989-e80b-4818-b79a-16faa698cf34 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Getting quotas for project 6eb5fe9c67d048c5b2097f9a923ac025. Resources: {'instances', 'cores', 'ram'} {{(pid=96920) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:51:16.741805 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.quota [None req-f0b51989-e80b-4818-b79a-16faa698cf34 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Getting quotas for user f5b08a414e0c45ab839107cccb69f179 and project 6eb5fe9c67d048c5b2097f9a923ac025. Resources: {'instances', 'cores', 'ram'} {{(pid=96920) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:51:16.752417 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-f0b51989-e80b-4818-b79a-16faa698cf34 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Going to run 1 instances... {{(pid=96920) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} Apr 08 02:51:16.754745 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-f0b51989-e80b-4818-b79a-16faa698cf34 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] [instance: dac91570-d62d-4a3c-a83c-20a727657c9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6c764dd8-48e2-46de-93d7-e0b940eaf421',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=96920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} Apr 08 02:51:16.798052 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-f0b51989-e80b-4818-b79a-16faa698cf34 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.745174 Apr 08 02:51:16.798707 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 287/568] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Apr 8 02:51:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 08 02:51:16.814938 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-0c02c673-8a7d-40d3-8fce-e192adc3e86b tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:16.815671 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-0c02c673-8a7d-40d3-8fce-e192adc3e86b tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] [instance: dac91570-d62d-4a3c-a83c-20a727657c9d] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:51:16.893056 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-0c02c673-8a7d-40d3-8fce-e192adc3e86b tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b08a414e0c45ab839107cccb69f179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb5fe9c67d048c5b2097f9a923ac025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:51:16.901114 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-0c02c673-8a7d-40d3-8fce-e192adc3e86b tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] 10.222.0.48 "GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d" status: 200 len: 1258 microversion: 2.1 time: 0.096591 Apr 08 02:51:16.901892 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 282/569] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:16 2022] GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d => generated 1258 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:51:17.923033 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-eac5011b-179b-4d4e-b70d-5d276da98933 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:17.923626 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-eac5011b-179b-4d4e-b70d-5d276da98933 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] [instance: dac91570-d62d-4a3c-a83c-20a727657c9d] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:51:17.932095 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-eac5011b-179b-4d4e-b70d-5d276da98933 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:17.932534 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-eac5011b-179b-4d4e-b70d-5d276da98933 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:17.933310 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-eac5011b-179b-4d4e-b70d-5d276da98933 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:17.933747 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-eac5011b-179b-4d4e-b70d-5d276da98933 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:18.059570 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-eac5011b-179b-4d4e-b70d-5d276da98933 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b08a414e0c45ab839107cccb69f179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb5fe9c67d048c5b2097f9a923ac025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:51:18.068278 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-eac5011b-179b-4d4e-b70d-5d276da98933 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] 10.222.0.48 "GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d" status: 200 len: 1328 microversion: 2.1 time: 0.155150 Apr 08 02:51:18.068820 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 288/570] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:17 2022] GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d => generated 1328 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:51:19.091086 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-daa05321-b249-4adc-a04d-d48a6beb637b tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:19.091783 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-daa05321-b249-4adc-a04d-d48a6beb637b tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] [instance: dac91570-d62d-4a3c-a83c-20a727657c9d] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:51:19.100560 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-daa05321-b249-4adc-a04d-d48a6beb637b tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:19.101133 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-daa05321-b249-4adc-a04d-d48a6beb637b tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:19.102638 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-daa05321-b249-4adc-a04d-d48a6beb637b tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:19.103301 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-daa05321-b249-4adc-a04d-d48a6beb637b tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:19.346259 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-daa05321-b249-4adc-a04d-d48a6beb637b tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b08a414e0c45ab839107cccb69f179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb5fe9c67d048c5b2097f9a923ac025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:51:19.354742 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-daa05321-b249-4adc-a04d-d48a6beb637b tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] 10.222.0.48 "GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d" status: 200 len: 1358 microversion: 2.1 time: 0.273164 Apr 08 02:51:19.364349 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 283/571] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:19 2022] GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d => generated 1358 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:51:20.377099 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-c50830eb-25d5-4e19-964a-c07915cf9e09 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:20.377682 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-c50830eb-25d5-4e19-964a-c07915cf9e09 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] [instance: dac91570-d62d-4a3c-a83c-20a727657c9d] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:51:20.385965 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c50830eb-25d5-4e19-964a-c07915cf9e09 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:20.386417 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c50830eb-25d5-4e19-964a-c07915cf9e09 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:20.387481 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c50830eb-25d5-4e19-964a-c07915cf9e09 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:20.387910 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c50830eb-25d5-4e19-964a-c07915cf9e09 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:20.597814 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-c50830eb-25d5-4e19-964a-c07915cf9e09 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b08a414e0c45ab839107cccb69f179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb5fe9c67d048c5b2097f9a923ac025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:51:20.606301 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-c50830eb-25d5-4e19-964a-c07915cf9e09 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] 10.222.0.48 "GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d" status: 200 len: 1358 microversion: 2.1 time: 0.238043 Apr 08 02:51:20.607085 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 289/572] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:20 2022] GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d => generated 1358 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:51:21.628563 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-ebd6d211-ee1d-4d13-98d1-51fb3e12afa8 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:21.629169 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-ebd6d211-ee1d-4d13-98d1-51fb3e12afa8 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] [instance: dac91570-d62d-4a3c-a83c-20a727657c9d] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:51:21.637517 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ebd6d211-ee1d-4d13-98d1-51fb3e12afa8 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:21.637959 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ebd6d211-ee1d-4d13-98d1-51fb3e12afa8 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:21.638756 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ebd6d211-ee1d-4d13-98d1-51fb3e12afa8 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:21.639187 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ebd6d211-ee1d-4d13-98d1-51fb3e12afa8 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:21.855699 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-ebd6d211-ee1d-4d13-98d1-51fb3e12afa8 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b08a414e0c45ab839107cccb69f179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb5fe9c67d048c5b2097f9a923ac025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:51:21.865547 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-ebd6d211-ee1d-4d13-98d1-51fb3e12afa8 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] 10.222.0.48 "GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d" status: 200 len: 1358 microversion: 2.1 time: 0.246179 Apr 08 02:51:21.866285 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 284/573] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:21 2022] GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d => generated 1358 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:51:22.888285 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-e7c0faeb-b922-4b91-bbc0-831b473a6853 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:22.888948 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-e7c0faeb-b922-4b91-bbc0-831b473a6853 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] [instance: dac91570-d62d-4a3c-a83c-20a727657c9d] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:51:22.896405 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-e7c0faeb-b922-4b91-bbc0-831b473a6853 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:22.896846 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-e7c0faeb-b922-4b91-bbc0-831b473a6853 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:22.897646 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-e7c0faeb-b922-4b91-bbc0-831b473a6853 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:22.898070 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-e7c0faeb-b922-4b91-bbc0-831b473a6853 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:23.120329 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-e7c0faeb-b922-4b91-bbc0-831b473a6853 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b08a414e0c45ab839107cccb69f179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb5fe9c67d048c5b2097f9a923ac025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:51:23.128903 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-e7c0faeb-b922-4b91-bbc0-831b473a6853 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] 10.222.0.48 "GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d" status: 200 len: 1358 microversion: 2.1 time: 0.250342 Apr 08 02:51:23.129451 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 290/574] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:22 2022] GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d => generated 1358 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:51:24.153118 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-b1746474-51c4-4c59-a874-956f32b4d618 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:24.153714 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-b1746474-51c4-4c59-a874-956f32b4d618 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] [instance: dac91570-d62d-4a3c-a83c-20a727657c9d] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:51:24.161417 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b1746474-51c4-4c59-a874-956f32b4d618 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:24.161859 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b1746474-51c4-4c59-a874-956f32b4d618 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:24.162635 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b1746474-51c4-4c59-a874-956f32b4d618 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:24.163092 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b1746474-51c4-4c59-a874-956f32b4d618 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:24.373572 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-b1746474-51c4-4c59-a874-956f32b4d618 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b08a414e0c45ab839107cccb69f179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb5fe9c67d048c5b2097f9a923ac025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:51:24.381514 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-b1746474-51c4-4c59-a874-956f32b4d618 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] 10.222.0.48 "GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d" status: 200 len: 1358 microversion: 2.1 time: 0.238288 Apr 08 02:51:24.382040 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 285/575] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:24 2022] GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d => generated 1358 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:51:25.404721 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-49f26092-0faf-4514-a5b5-054404daa84f tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:25.405318 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-49f26092-0faf-4514-a5b5-054404daa84f tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] [instance: dac91570-d62d-4a3c-a83c-20a727657c9d] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:51:25.412885 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-49f26092-0faf-4514-a5b5-054404daa84f tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:25.413396 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-49f26092-0faf-4514-a5b5-054404daa84f tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:25.414113 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-49f26092-0faf-4514-a5b5-054404daa84f tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:25.415322 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-49f26092-0faf-4514-a5b5-054404daa84f tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:25.619906 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-49f26092-0faf-4514-a5b5-054404daa84f tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b08a414e0c45ab839107cccb69f179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb5fe9c67d048c5b2097f9a923ac025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:51:25.628410 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-49f26092-0faf-4514-a5b5-054404daa84f tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] 10.222.0.48 "GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d" status: 200 len: 1358 microversion: 2.1 time: 0.233045 Apr 08 02:51:25.629310 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 291/576] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:25 2022] GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d => generated 1358 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:51:26.651906 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-377acb08-a446-4553-9f20-47c8af944671 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:26.652588 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-377acb08-a446-4553-9f20-47c8af944671 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] [instance: dac91570-d62d-4a3c-a83c-20a727657c9d] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:51:26.659962 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-377acb08-a446-4553-9f20-47c8af944671 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:26.660401 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-377acb08-a446-4553-9f20-47c8af944671 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:26.661159 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-377acb08-a446-4553-9f20-47c8af944671 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:26.661584 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-377acb08-a446-4553-9f20-47c8af944671 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:26.873680 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-377acb08-a446-4553-9f20-47c8af944671 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b08a414e0c45ab839107cccb69f179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb5fe9c67d048c5b2097f9a923ac025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:51:26.881547 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-377acb08-a446-4553-9f20-47c8af944671 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] 10.222.0.48 "GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d" status: 200 len: 1358 microversion: 2.1 time: 0.239726 Apr 08 02:51:26.882073 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 286/577] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:26 2022] GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d => generated 1358 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:51:27.903050 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-65fd4fac-8b2f-4694-bbb1-1990353a75a7 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:27.903676 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-65fd4fac-8b2f-4694-bbb1-1990353a75a7 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] [instance: dac91570-d62d-4a3c-a83c-20a727657c9d] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:51:27.911003 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-65fd4fac-8b2f-4694-bbb1-1990353a75a7 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:27.911448 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-65fd4fac-8b2f-4694-bbb1-1990353a75a7 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:27.912230 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-65fd4fac-8b2f-4694-bbb1-1990353a75a7 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:27.912652 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-65fd4fac-8b2f-4694-bbb1-1990353a75a7 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:28.128166 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-65fd4fac-8b2f-4694-bbb1-1990353a75a7 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b08a414e0c45ab839107cccb69f179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb5fe9c67d048c5b2097f9a923ac025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:51:28.136653 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-65fd4fac-8b2f-4694-bbb1-1990353a75a7 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] 10.222.0.48 "GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d" status: 200 len: 1358 microversion: 2.1 time: 0.242510 Apr 08 02:51:28.137441 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 292/578] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:27 2022] GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d => generated 1358 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:51:29.160119 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-567480a8-955a-4743-a6fb-aec64271a8b9 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:29.160738 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-567480a8-955a-4743-a6fb-aec64271a8b9 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] [instance: dac91570-d62d-4a3c-a83c-20a727657c9d] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:51:29.168637 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-567480a8-955a-4743-a6fb-aec64271a8b9 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:29.169086 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-567480a8-955a-4743-a6fb-aec64271a8b9 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:29.169865 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-567480a8-955a-4743-a6fb-aec64271a8b9 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:29.170413 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-567480a8-955a-4743-a6fb-aec64271a8b9 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:29.379919 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-567480a8-955a-4743-a6fb-aec64271a8b9 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b08a414e0c45ab839107cccb69f179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb5fe9c67d048c5b2097f9a923ac025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:51:29.389267 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-567480a8-955a-4743-a6fb-aec64271a8b9 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] 10.222.0.48 "GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d" status: 200 len: 1358 microversion: 2.1 time: 0.239290 Apr 08 02:51:29.389797 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 287/579] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:29 2022] GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d => generated 1358 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:51:30.411745 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-6d1f39c9-911a-483f-983b-1a94315959d6 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:30.412396 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-6d1f39c9-911a-483f-983b-1a94315959d6 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] [instance: dac91570-d62d-4a3c-a83c-20a727657c9d] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:51:30.420127 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-6d1f39c9-911a-483f-983b-1a94315959d6 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:30.420578 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-6d1f39c9-911a-483f-983b-1a94315959d6 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:30.421354 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-6d1f39c9-911a-483f-983b-1a94315959d6 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:30.421785 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-6d1f39c9-911a-483f-983b-1a94315959d6 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:30.622465 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-6d1f39c9-911a-483f-983b-1a94315959d6 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b08a414e0c45ab839107cccb69f179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb5fe9c67d048c5b2097f9a923ac025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:51:30.630869 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-6d1f39c9-911a-483f-983b-1a94315959d6 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] 10.222.0.48 "GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d" status: 200 len: 1358 microversion: 2.1 time: 0.228029 Apr 08 02:51:30.631414 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 293/580] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:30 2022] GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d => generated 1358 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:51:31.652367 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-bfe996f6-d93f-4964-8741-816faf3f0af7 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:31.652952 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-bfe996f6-d93f-4964-8741-816faf3f0af7 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] [instance: dac91570-d62d-4a3c-a83c-20a727657c9d] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:51:31.660096 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-bfe996f6-d93f-4964-8741-816faf3f0af7 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:31.660531 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-bfe996f6-d93f-4964-8741-816faf3f0af7 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:31.661278 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-bfe996f6-d93f-4964-8741-816faf3f0af7 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:31.661703 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-bfe996f6-d93f-4964-8741-816faf3f0af7 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:31.862370 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-bfe996f6-d93f-4964-8741-816faf3f0af7 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b08a414e0c45ab839107cccb69f179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb5fe9c67d048c5b2097f9a923ac025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:51:31.870355 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-bfe996f6-d93f-4964-8741-816faf3f0af7 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] 10.222.0.48 "GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d" status: 200 len: 1358 microversion: 2.1 time: 0.227029 Apr 08 02:51:31.870918 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 288/581] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:31 2022] GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d => generated 1358 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:51:32.893100 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-c7b8e44e-76a7-41af-94f1-7802c50d281a tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:32.893697 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-c7b8e44e-76a7-41af-94f1-7802c50d281a tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] [instance: dac91570-d62d-4a3c-a83c-20a727657c9d] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:51:32.901184 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c7b8e44e-76a7-41af-94f1-7802c50d281a tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:32.901651 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c7b8e44e-76a7-41af-94f1-7802c50d281a tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:32.902411 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c7b8e44e-76a7-41af-94f1-7802c50d281a tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:32.902880 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c7b8e44e-76a7-41af-94f1-7802c50d281a tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:33.104600 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-c7b8e44e-76a7-41af-94f1-7802c50d281a tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b08a414e0c45ab839107cccb69f179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb5fe9c67d048c5b2097f9a923ac025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:51:33.112438 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-c7b8e44e-76a7-41af-94f1-7802c50d281a tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] 10.222.0.48 "GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d" status: 200 len: 1358 microversion: 2.1 time: 0.229205 Apr 08 02:51:33.112963 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 294/582] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:32 2022] GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d => generated 1358 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:51:34.135031 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-84af84af-4271-4cf0-9f60-689911da3251 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:34.135620 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-84af84af-4271-4cf0-9f60-689911da3251 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] [instance: dac91570-d62d-4a3c-a83c-20a727657c9d] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:51:34.143152 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-84af84af-4271-4cf0-9f60-689911da3251 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:34.143590 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-84af84af-4271-4cf0-9f60-689911da3251 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:34.144340 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-84af84af-4271-4cf0-9f60-689911da3251 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:34.144761 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-84af84af-4271-4cf0-9f60-689911da3251 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:34.345287 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-84af84af-4271-4cf0-9f60-689911da3251 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b08a414e0c45ab839107cccb69f179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb5fe9c67d048c5b2097f9a923ac025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:51:34.354094 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-84af84af-4271-4cf0-9f60-689911da3251 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] 10.222.0.48 "GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d" status: 200 len: 1358 microversion: 2.1 time: 0.227952 Apr 08 02:51:34.354630 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 289/583] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:34 2022] GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d => generated 1358 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:51:35.143543 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [req-f8feb462-f96c-4a76-ae96-4aa42bfcaa03 req-0b05b194-1400-432c-8f24-81957a453bb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dac91570-d62d-4a3c-a83c-20a727657c9d", "tag": "f7bd9446-7011-458c-94be-2eb73cc73b68"}]} {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:51:35.150626 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:51:35.150626 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: warnings.warn(msg) Apr 08 02:51:35.159131 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-f8feb462-f96c-4a76-ae96-4aa42bfcaa03 req-0b05b194-1400-432c-8f24-81957a453bb2 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:35.159768 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-f8feb462-f96c-4a76-ae96-4aa42bfcaa03 req-0b05b194-1400-432c-8f24-81957a453bb2 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:35.180038 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.compute.server_external_events [req-f8feb462-f96c-4a76-ae96-4aa42bfcaa03 req-0b05b194-1400-432c-8f24-81957a453bb2 service nova] Creating event network-changed:f7bd9446-7011-458c-94be-2eb73cc73b68 for instance dac91570-d62d-4a3c-a83c-20a727657c9d on hv-cinder-83705 Apr 08 02:51:35.184851 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [req-f8feb462-f96c-4a76-ae96-4aa42bfcaa03 req-0b05b194-1400-432c-8f24-81957a453bb2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052446 Apr 08 02:51:35.185575 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 295/584] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:51:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:51:35.350366 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-52e83af0-9ea8-4576-83f5-3c5eb8764e38 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:35.350907 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-52e83af0-9ea8-4576-83f5-3c5eb8764e38 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 19ff8616-8e62-40fe-87e7-f976433b9288] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:51:35.359469 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-52e83af0-9ea8-4576-83f5-3c5eb8764e38 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:35.359918 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-52e83af0-9ea8-4576-83f5-3c5eb8764e38 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:35.360695 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-52e83af0-9ea8-4576-83f5-3c5eb8764e38 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:35.361297 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-52e83af0-9ea8-4576-83f5-3c5eb8764e38 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:35.378983 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-68dbaca9-c227-4b59-8d9e-8885aeed183c tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:35.379909 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-68dbaca9-c227-4b59-8d9e-8885aeed183c tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] [instance: dac91570-d62d-4a3c-a83c-20a727657c9d] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:51:35.388139 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-68dbaca9-c227-4b59-8d9e-8885aeed183c tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:35.388775 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-68dbaca9-c227-4b59-8d9e-8885aeed183c tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:35.389563 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-68dbaca9-c227-4b59-8d9e-8885aeed183c tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:35.389988 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-68dbaca9-c227-4b59-8d9e-8885aeed183c tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:35.622619 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-68dbaca9-c227-4b59-8d9e-8885aeed183c tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b08a414e0c45ab839107cccb69f179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb5fe9c67d048c5b2097f9a923ac025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:51:35.625792 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-52e83af0-9ea8-4576-83f5-3c5eb8764e38 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "DELETE /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288/os-volume_attachments/ce8c1190-1af4-4aca-be3d-2e09f424ffb4" status: 202 len: 0 microversion: 2.1 time: 0.423298 Apr 08 02:51:35.626657 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 290/585] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Apr 8 02:51:35 2022] DELETE /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288/os-volume_attachments/ce8c1190-1af4-4aca-be3d-2e09f424ffb4 => generated 0 bytes in 425 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 02:51:35.633177 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-68dbaca9-c227-4b59-8d9e-8885aeed183c tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] 10.222.0.48 "GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d" status: 200 len: 1358 microversion: 2.1 time: 0.265498 Apr 08 02:51:35.633724 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 296/586] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:35 2022] GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d => generated 1358 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:51:36.655735 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-6d8e30c0-a266-4b7b-b542-2c0110283570 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:36.656423 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-6d8e30c0-a266-4b7b-b542-2c0110283570 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] [instance: dac91570-d62d-4a3c-a83c-20a727657c9d] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:51:36.663773 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-6d8e30c0-a266-4b7b-b542-2c0110283570 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:36.664213 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-6d8e30c0-a266-4b7b-b542-2c0110283570 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:36.664977 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-6d8e30c0-a266-4b7b-b542-2c0110283570 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:36.666006 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-6d8e30c0-a266-4b7b-b542-2c0110283570 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:36.821002 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-991c2865-3bda-4524-8b1e-8771abd0ee7a tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:51:36.828790 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-991c2865-3bda-4524-8b1e-8771abd0ee7a tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:36.829228 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-991c2865-3bda-4524-8b1e-8771abd0ee7a tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:36.871089 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-6d8e30c0-a266-4b7b-b542-2c0110283570 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b08a414e0c45ab839107cccb69f179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb5fe9c67d048c5b2097f9a923ac025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:51:36.879129 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-6d8e30c0-a266-4b7b-b542-2c0110283570 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] 10.222.0.48 "GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d" status: 200 len: 1358 microversion: 2.1 time: 0.233474 Apr 08 02:51:36.879766 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 291/587] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:36 2022] GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d => generated 1358 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:51:36.889630 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-991c2865-3bda-4524-8b1e-8771abd0ee7a tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 19ff8616-8e62-40fe-87e7-f976433b9288] Going to try to stop instance {{(pid=96920) force_stop /opt/stack/nova/nova/compute/api.py:2599}} Apr 08 02:51:36.962070 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-991c2865-3bda-4524-8b1e-8771abd0ee7a tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "POST /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288/action" status: 202 len: 0 microversion: 2.1 time: 0.149660 Apr 08 02:51:36.963104 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 297/588] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Apr 8 02:51:36 2022] POST /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 08 02:51:36.976397 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-98d70bd7-a015-4ca3-89b4-e988d9b08717 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:36.977096 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-98d70bd7-a015-4ca3-89b4-e988d9b08717 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 19ff8616-8e62-40fe-87e7-f976433b9288] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:51:36.987375 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-98d70bd7-a015-4ca3-89b4-e988d9b08717 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:36.988185 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-98d70bd7-a015-4ca3-89b4-e988d9b08717 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:36.989598 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-98d70bd7-a015-4ca3-89b4-e988d9b08717 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:36.990394 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-98d70bd7-a015-4ca3-89b4-e988d9b08717 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:37.249402 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-98d70bd7-a015-4ca3-89b4-e988d9b08717 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a88a8d7c9e4d0a88308c0e894570be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c31bb4f3ce486591bc142b1da7553e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:51:37.257294 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-98d70bd7-a015-4ca3-89b4-e988d9b08717 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288" status: 200 len: 1675 microversion: 2.1 time: 0.290058 Apr 08 02:51:37.257813 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 292/589] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:36 2022] GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288 => generated 1675 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:51:37.903713 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-8e212c46-7e0e-415b-afa7-c48f08692c56 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:37.904514 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-8e212c46-7e0e-415b-afa7-c48f08692c56 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] [instance: dac91570-d62d-4a3c-a83c-20a727657c9d] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:51:37.913595 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-8e212c46-7e0e-415b-afa7-c48f08692c56 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:37.914075 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-8e212c46-7e0e-415b-afa7-c48f08692c56 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:37.915119 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-8e212c46-7e0e-415b-afa7-c48f08692c56 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:37.915771 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-8e212c46-7e0e-415b-afa7-c48f08692c56 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:38.133906 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-8e212c46-7e0e-415b-afa7-c48f08692c56 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b08a414e0c45ab839107cccb69f179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb5fe9c67d048c5b2097f9a923ac025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:51:38.142410 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-8e212c46-7e0e-415b-afa7-c48f08692c56 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] 10.222.0.48 "GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d" status: 200 len: 1358 microversion: 2.1 time: 0.249524 Apr 08 02:51:38.143527 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 298/590] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:37 2022] GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d => generated 1358 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:51:38.280497 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-41ccb818-af57-4f41-a2ae-02637e6f186b tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:38.281095 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-41ccb818-af57-4f41-a2ae-02637e6f186b tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 19ff8616-8e62-40fe-87e7-f976433b9288] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:51:38.288377 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-41ccb818-af57-4f41-a2ae-02637e6f186b tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:38.288843 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-41ccb818-af57-4f41-a2ae-02637e6f186b tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:38.289612 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-41ccb818-af57-4f41-a2ae-02637e6f186b tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:38.290200 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-41ccb818-af57-4f41-a2ae-02637e6f186b tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:38.491643 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-41ccb818-af57-4f41-a2ae-02637e6f186b tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a88a8d7c9e4d0a88308c0e894570be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c31bb4f3ce486591bc142b1da7553e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:51:38.499944 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-41ccb818-af57-4f41-a2ae-02637e6f186b tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288" status: 200 len: 1675 microversion: 2.1 time: 0.228970 Apr 08 02:51:38.500845 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 293/591] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:38 2022] GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288 => generated 1675 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:51:39.165651 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-68a22a40-34ae-408d-ba67-a72447eb1c40 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:39.166424 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-68a22a40-34ae-408d-ba67-a72447eb1c40 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] [instance: dac91570-d62d-4a3c-a83c-20a727657c9d] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:51:39.173955 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-68a22a40-34ae-408d-ba67-a72447eb1c40 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:39.174352 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-68a22a40-34ae-408d-ba67-a72447eb1c40 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:39.175246 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-68a22a40-34ae-408d-ba67-a72447eb1c40 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:39.175680 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-68a22a40-34ae-408d-ba67-a72447eb1c40 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:39.388471 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-68a22a40-34ae-408d-ba67-a72447eb1c40 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b08a414e0c45ab839107cccb69f179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb5fe9c67d048c5b2097f9a923ac025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:51:39.398692 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-68a22a40-34ae-408d-ba67-a72447eb1c40 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] 10.222.0.48 "GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d" status: 200 len: 1358 microversion: 2.1 time: 0.242513 Apr 08 02:51:39.399215 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 299/592] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:39 2022] GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d => generated 1358 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:51:39.522715 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-05d570f3-9f86-4103-9489-04a255e8602e tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:39.523313 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-05d570f3-9f86-4103-9489-04a255e8602e tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 19ff8616-8e62-40fe-87e7-f976433b9288] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:51:39.530626 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-05d570f3-9f86-4103-9489-04a255e8602e tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:39.531090 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-05d570f3-9f86-4103-9489-04a255e8602e tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:39.531854 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-05d570f3-9f86-4103-9489-04a255e8602e tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:39.532278 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-05d570f3-9f86-4103-9489-04a255e8602e tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:39.733127 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-05d570f3-9f86-4103-9489-04a255e8602e tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a88a8d7c9e4d0a88308c0e894570be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c31bb4f3ce486591bc142b1da7553e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:51:39.741054 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-05d570f3-9f86-4103-9489-04a255e8602e tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288" status: 200 len: 1675 microversion: 2.1 time: 0.227429 Apr 08 02:51:39.741790 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 294/593] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:39 2022] GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288 => generated 1675 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:51:40.421443 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-17a94463-a128-4da9-8a49-94101c0bc90b tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:40.422041 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-17a94463-a128-4da9-8a49-94101c0bc90b tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] [instance: dac91570-d62d-4a3c-a83c-20a727657c9d] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:51:40.429218 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-17a94463-a128-4da9-8a49-94101c0bc90b tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:40.429661 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-17a94463-a128-4da9-8a49-94101c0bc90b tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:40.430416 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-17a94463-a128-4da9-8a49-94101c0bc90b tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:40.430947 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-17a94463-a128-4da9-8a49-94101c0bc90b tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:40.629202 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-17a94463-a128-4da9-8a49-94101c0bc90b tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b08a414e0c45ab839107cccb69f179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb5fe9c67d048c5b2097f9a923ac025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:51:40.637855 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-17a94463-a128-4da9-8a49-94101c0bc90b tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] 10.222.0.48 "GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d" status: 200 len: 1358 microversion: 2.1 time: 0.225977 Apr 08 02:51:40.638375 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 300/594] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:40 2022] GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d => generated 1358 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:51:40.764858 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-276f7d8b-5782-4162-bf9f-fdf2b75b83af tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:40.765404 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-276f7d8b-5782-4162-bf9f-fdf2b75b83af tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 19ff8616-8e62-40fe-87e7-f976433b9288] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:51:40.772593 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-276f7d8b-5782-4162-bf9f-fdf2b75b83af tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:40.773034 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-276f7d8b-5782-4162-bf9f-fdf2b75b83af tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:40.773796 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-276f7d8b-5782-4162-bf9f-fdf2b75b83af tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:40.774225 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-276f7d8b-5782-4162-bf9f-fdf2b75b83af tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:40.973785 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-276f7d8b-5782-4162-bf9f-fdf2b75b83af tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a88a8d7c9e4d0a88308c0e894570be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c31bb4f3ce486591bc142b1da7553e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:51:40.982736 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-276f7d8b-5782-4162-bf9f-fdf2b75b83af tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288" status: 200 len: 1675 microversion: 2.1 time: 0.227122 Apr 08 02:51:40.983276 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 295/595] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:40 2022] GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288 => generated 1675 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:51:41.659678 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-9dab4aa0-ac55-48bf-8628-29de22c4e030 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:41.660206 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-9dab4aa0-ac55-48bf-8628-29de22c4e030 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] [instance: dac91570-d62d-4a3c-a83c-20a727657c9d] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:51:41.667438 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-9dab4aa0-ac55-48bf-8628-29de22c4e030 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:41.667877 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-9dab4aa0-ac55-48bf-8628-29de22c4e030 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:41.668636 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-9dab4aa0-ac55-48bf-8628-29de22c4e030 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:41.669052 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-9dab4aa0-ac55-48bf-8628-29de22c4e030 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:41.891689 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-9dab4aa0-ac55-48bf-8628-29de22c4e030 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b08a414e0c45ab839107cccb69f179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb5fe9c67d048c5b2097f9a923ac025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:51:41.901567 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-9dab4aa0-ac55-48bf-8628-29de22c4e030 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] 10.222.0.48 "GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d" status: 200 len: 1358 microversion: 2.1 time: 0.250918 Apr 08 02:51:41.902111 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 301/596] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:41 2022] GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d => generated 1358 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:51:42.005425 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-84a94b9c-17e9-4a26-b149-2f1fd69928eb tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:42.006739 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-84a94b9c-17e9-4a26-b149-2f1fd69928eb tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 19ff8616-8e62-40fe-87e7-f976433b9288] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:51:42.015027 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-84a94b9c-17e9-4a26-b149-2f1fd69928eb tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:42.015949 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-84a94b9c-17e9-4a26-b149-2f1fd69928eb tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:42.016963 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-84a94b9c-17e9-4a26-b149-2f1fd69928eb tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:42.017615 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-84a94b9c-17e9-4a26-b149-2f1fd69928eb tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:42.229677 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-84a94b9c-17e9-4a26-b149-2f1fd69928eb tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a88a8d7c9e4d0a88308c0e894570be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c31bb4f3ce486591bc142b1da7553e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:51:42.237698 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-84a94b9c-17e9-4a26-b149-2f1fd69928eb tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288" status: 200 len: 1675 microversion: 2.1 time: 0.241199 Apr 08 02:51:42.238461 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 296/597] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:41 2022] GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288 => generated 1675 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:51:42.251752 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [req-56f08dd8-5f5e-4590-8c47-781806cb50fc req-b8644bc6-a4b2-4715-88d9-0e13e060dbf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dac91570-d62d-4a3c-a83c-20a727657c9d", "name": "network-vif-plugged", "status": "completed", "tag": "f7bd9446-7011-458c-94be-2eb73cc73b68"}]} {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:51:42.258202 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:51:42.258202 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: warnings.warn(msg) Apr 08 02:51:42.266611 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-56f08dd8-5f5e-4590-8c47-781806cb50fc req-b8644bc6-a4b2-4715-88d9-0e13e060dbf3 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:42.267072 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-56f08dd8-5f5e-4590-8c47-781806cb50fc req-b8644bc6-a4b2-4715-88d9-0e13e060dbf3 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:42.282980 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.compute.server_external_events [req-56f08dd8-5f5e-4590-8c47-781806cb50fc req-b8644bc6-a4b2-4715-88d9-0e13e060dbf3 service nova] Creating event network-vif-plugged:f7bd9446-7011-458c-94be-2eb73cc73b68 for instance dac91570-d62d-4a3c-a83c-20a727657c9d on hv-cinder-83705 Apr 08 02:51:42.287916 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [req-56f08dd8-5f5e-4590-8c47-781806cb50fc req-b8644bc6-a4b2-4715-88d9-0e13e060dbf3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045850 Apr 08 02:51:42.288693 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 302/598] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:51:42.867216 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-1a76b6f6-5daf-4bde-95f8-a68e218b648f tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:42.867711 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-1a76b6f6-5daf-4bde-95f8-a68e218b648f tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: de7be542-3f1f-4b34-a68c-4500efe9f8d9] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:51:42.876114 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-1a76b6f6-5daf-4bde-95f8-a68e218b648f tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:42.876588 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-1a76b6f6-5daf-4bde-95f8-a68e218b648f tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:42.877362 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-1a76b6f6-5daf-4bde-95f8-a68e218b648f tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:42.877796 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-1a76b6f6-5daf-4bde-95f8-a68e218b648f tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:42.923660 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-906eac76-9e66-4ed6-803d-b4c8679e33d7 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:42.924451 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-906eac76-9e66-4ed6-803d-b4c8679e33d7 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] [instance: dac91570-d62d-4a3c-a83c-20a727657c9d] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:51:42.932442 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-906eac76-9e66-4ed6-803d-b4c8679e33d7 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:42.932890 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-906eac76-9e66-4ed6-803d-b4c8679e33d7 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:42.933665 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-906eac76-9e66-4ed6-803d-b4c8679e33d7 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:42.934098 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-906eac76-9e66-4ed6-803d-b4c8679e33d7 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:42.944055 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-1a76b6f6-5daf-4bde-95f8-a68e218b648f tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/de7be542-3f1f-4b34-a68c-4500efe9f8d9/ips" status: 200 len: 149 microversion: 2.1 time: 0.211702 Apr 08 02:51:42.950107 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 297/599] 10.222.0.48 () {58 vars in 1247 bytes} [Fri Apr 8 02:51:42 2022] GET /compute/v2.1/servers/de7be542-3f1f-4b34-a68c-4500efe9f8d9/ips => generated 149 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:51:42.960491 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-2093ac06-14d3-46a0-b5a7-4d5da19ecd21 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0e193ec0-2248-42d7-8834-e4992c0590f3"}} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:51:42.961728 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-2093ac06-14d3-46a0-b5a7-4d5da19ecd21 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: de7be542-3f1f-4b34-a68c-4500efe9f8d9] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:51:42.969191 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-2093ac06-14d3-46a0-b5a7-4d5da19ecd21 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:42.969637 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-2093ac06-14d3-46a0-b5a7-4d5da19ecd21 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:42.970410 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-2093ac06-14d3-46a0-b5a7-4d5da19ecd21 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:42.970872 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-2093ac06-14d3-46a0-b5a7-4d5da19ecd21 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:43.151198 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-906eac76-9e66-4ed6-803d-b4c8679e33d7 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b08a414e0c45ab839107cccb69f179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb5fe9c67d048c5b2097f9a923ac025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:51:43.159058 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-906eac76-9e66-4ed6-803d-b4c8679e33d7 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] 10.222.0.48 "GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d" status: 200 len: 1358 microversion: 2.1 time: 0.245449 Apr 08 02:51:43.159590 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 303/600] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:42 2022] GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d => generated 1358 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:51:43.263298 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-770f6b38-2f13-46b8-8088-a41e226c8d49 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:43.263897 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-770f6b38-2f13-46b8-8088-a41e226c8d49 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 19ff8616-8e62-40fe-87e7-f976433b9288] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:51:43.270972 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-770f6b38-2f13-46b8-8088-a41e226c8d49 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:43.271413 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-770f6b38-2f13-46b8-8088-a41e226c8d49 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:43.272176 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-770f6b38-2f13-46b8-8088-a41e226c8d49 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:43.272598 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-770f6b38-2f13-46b8-8088-a41e226c8d49 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:43.480472 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.wsgi [None req-2093ac06-14d3-46a0-b5a7-4d5da19ecd21 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] HTTP exception thrown: Invalid input received: Invalid volume: Volume 0e193ec0-2248-42d7-8834-e4992c0590f3 status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-89828abf-ca21-4346-a8ab-1a340b5709c5) Apr 08 02:51:43.481268 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-2093ac06-14d3-46a0-b5a7-4d5da19ecd21 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Returning 400 to user: Invalid input received: Invalid volume: Volume 0e193ec0-2248-42d7-8834-e4992c0590f3 status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-89828abf-ca21-4346-a8ab-1a340b5709c5) {{(pid=96919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Apr 08 02:51:43.482093 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-2093ac06-14d3-46a0-b5a7-4d5da19ecd21 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "POST /compute/v2.1/servers/de7be542-3f1f-4b34-a68c-4500efe9f8d9/os-volume_attachments" status: 400 len: 279 microversion: 2.1 time: 0.530649 Apr 08 02:51:43.482673 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 298/601] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Apr 8 02:51:42 2022] POST /compute/v2.1/servers/de7be542-3f1f-4b34-a68c-4500efe9f8d9/os-volume_attachments => generated 279 bytes in 532 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 08 02:51:43.482803 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-770f6b38-2f13-46b8-8088-a41e226c8d49 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a88a8d7c9e4d0a88308c0e894570be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c31bb4f3ce486591bc142b1da7553e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:51:43.490951 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-770f6b38-2f13-46b8-8088-a41e226c8d49 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288" status: 200 len: 1675 microversion: 2.1 time: 0.237946 Apr 08 02:51:43.491473 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 304/602] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:43 2022] GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288 => generated 1675 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:51:43.497612 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-0e7b226a-2908-4b03-93a7-1e2bd58b73de tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:43.498193 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-0e7b226a-2908-4b03-93a7-1e2bd58b73de tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: de7be542-3f1f-4b34-a68c-4500efe9f8d9] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:51:43.505462 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-0e7b226a-2908-4b03-93a7-1e2bd58b73de tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:43.505906 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-0e7b226a-2908-4b03-93a7-1e2bd58b73de tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:43.506685 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-0e7b226a-2908-4b03-93a7-1e2bd58b73de tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:43.507196 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-0e7b226a-2908-4b03-93a7-1e2bd58b73de tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:43.570526 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-0e7b226a-2908-4b03-93a7-1e2bd58b73de tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: de7be542-3f1f-4b34-a68c-4500efe9f8d9] Going to try to terminate instance {{(pid=96919) delete /opt/stack/nova/nova/compute/api.py:2559}} Apr 08 02:51:43.684048 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-0e7b226a-2908-4b03-93a7-1e2bd58b73de tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "DELETE /compute/v2.1/servers/de7be542-3f1f-4b34-a68c-4500efe9f8d9" status: 204 len: 0 microversion: 2.1 time: 0.196589 Apr 08 02:51:43.684924 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 299/603] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Apr 8 02:51:43 2022] DELETE /compute/v2.1/servers/de7be542-3f1f-4b34-a68c-4500efe9f8d9 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 08 02:51:43.699710 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-3af71af8-b787-450b-a437-8d14fb7be0aa tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:43.700306 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-3af71af8-b787-450b-a437-8d14fb7be0aa tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: de7be542-3f1f-4b34-a68c-4500efe9f8d9] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:51:43.707415 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-3af71af8-b787-450b-a437-8d14fb7be0aa tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:43.707850 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-3af71af8-b787-450b-a437-8d14fb7be0aa tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:43.708612 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-3af71af8-b787-450b-a437-8d14fb7be0aa tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:43.709037 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-3af71af8-b787-450b-a437-8d14fb7be0aa tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:43.912700 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-3af71af8-b787-450b-a437-8d14fb7be0aa tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68bc45984974d6da1c9151c21dae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbf5bb7e51d4d2d8594d6d1d3a797a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:51:43.921293 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-3af71af8-b787-450b-a437-8d14fb7be0aa tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/de7be542-3f1f-4b34-a68c-4500efe9f8d9" status: 200 len: 1681 microversion: 2.1 time: 0.231001 Apr 08 02:51:43.921825 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 305/604] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:43 2022] GET /compute/v2.1/servers/de7be542-3f1f-4b34-a68c-4500efe9f8d9 => generated 1681 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:51:44.181581 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-22c1cc1f-5488-4561-8c6b-8083b8e1ce4a tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:44.182352 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-22c1cc1f-5488-4561-8c6b-8083b8e1ce4a tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] [instance: dac91570-d62d-4a3c-a83c-20a727657c9d] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:51:44.189750 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-22c1cc1f-5488-4561-8c6b-8083b8e1ce4a tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:44.190183 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-22c1cc1f-5488-4561-8c6b-8083b8e1ce4a tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:44.190971 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-22c1cc1f-5488-4561-8c6b-8083b8e1ce4a tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:44.191401 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-22c1cc1f-5488-4561-8c6b-8083b8e1ce4a tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:44.395520 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-22c1cc1f-5488-4561-8c6b-8083b8e1ce4a tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b08a414e0c45ab839107cccb69f179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb5fe9c67d048c5b2097f9a923ac025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:51:44.403862 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-22c1cc1f-5488-4561-8c6b-8083b8e1ce4a tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] 10.222.0.48 "GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d" status: 200 len: 1549 microversion: 2.1 time: 0.231832 Apr 08 02:51:44.404387 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 300/605] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:44 2022] GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d => generated 1549 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:51:44.425217 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-4090e2ed-cfc0-44c6-b050-45e8b57fe12b tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:44.425812 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-4090e2ed-cfc0-44c6-b050-45e8b57fe12b tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] [instance: dac91570-d62d-4a3c-a83c-20a727657c9d] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:51:44.433633 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-4090e2ed-cfc0-44c6-b050-45e8b57fe12b tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:44.434155 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-4090e2ed-cfc0-44c6-b050-45e8b57fe12b tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:44.434955 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-4090e2ed-cfc0-44c6-b050-45e8b57fe12b tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:44.435362 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-4090e2ed-cfc0-44c6-b050-45e8b57fe12b tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:44.513041 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-2008e05b-53bf-4b57-9def-88bad49ebe9e tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:44.513750 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-2008e05b-53bf-4b57-9def-88bad49ebe9e tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 19ff8616-8e62-40fe-87e7-f976433b9288] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:51:44.521005 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-2008e05b-53bf-4b57-9def-88bad49ebe9e tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:44.521537 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-2008e05b-53bf-4b57-9def-88bad49ebe9e tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:44.522403 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-2008e05b-53bf-4b57-9def-88bad49ebe9e tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:44.522874 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-2008e05b-53bf-4b57-9def-88bad49ebe9e tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:44.676202 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-4090e2ed-cfc0-44c6-b050-45e8b57fe12b tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b08a414e0c45ab839107cccb69f179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb5fe9c67d048c5b2097f9a923ac025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:51:44.684897 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-4090e2ed-cfc0-44c6-b050-45e8b57fe12b tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] 10.222.0.48 "GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d" status: 200 len: 1549 microversion: 2.1 time: 0.268600 Apr 08 02:51:44.685429 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 306/606] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:44 2022] GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d => generated 1549 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:51:44.705467 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-d5abb414-df45-4b00-8190-a8fff34cd669 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:44.717893 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:51:44.717893 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: warnings.warn(msg) Apr 08 02:51:44.718893 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-d5abb414-df45-4b00-8190-a8fff34cd669 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f5b08a414e0c45ab839107cccb69f179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb5fe9c67d048c5b2097f9a923ac025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:51:44.719631 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-d5abb414-df45-4b00-8190-a8fff34cd669 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Searching by: {'deleted': False, 'project_id': '6eb5fe9c67d048c5b2097f9a923ac025'} {{(pid=96920) get_all /opt/stack/nova/nova/compute/api.py:2852}} Apr 08 02:51:44.725028 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-d5abb414-df45-4b00-8190-a8fff34cd669 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:44.725462 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-d5abb414-df45-4b00-8190-a8fff34cd669 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:44.726241 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-d5abb414-df45-4b00-8190-a8fff34cd669 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:44.726658 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-d5abb414-df45-4b00-8190-a8fff34cd669 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:44.752649 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-2008e05b-53bf-4b57-9def-88bad49ebe9e tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a88a8d7c9e4d0a88308c0e894570be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c31bb4f3ce486591bc142b1da7553e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:51:44.761384 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-2008e05b-53bf-4b57-9def-88bad49ebe9e tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288" status: 200 len: 1675 microversion: 2.1 time: 0.257650 Apr 08 02:51:44.761908 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 301/607] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:44 2022] GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288 => generated 1675 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:51:44.816020 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.multi_cell_list [None req-d5abb414-df45-4b00-8190-a8fff34cd669 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=96920) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Apr 08 02:51:44.907229 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-d5abb414-df45-4b00-8190-a8fff34cd669 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.210898 Apr 08 02:51:44.907787 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 307/608] 10.222.0.48 () {58 vars in 1124 bytes} [Fri Apr 8 02:51:44 2022] GET /compute/v2.1/servers => generated 343 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 02:51:44.922884 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-a00f226d-0b7f-4999-89cc-c50802246c40 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:44.923479 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-a00f226d-0b7f-4999-89cc-c50802246c40 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] [instance: dac91570-d62d-4a3c-a83c-20a727657c9d] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:51:44.931048 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-a00f226d-0b7f-4999-89cc-c50802246c40 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:44.931478 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-a00f226d-0b7f-4999-89cc-c50802246c40 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:44.932224 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-a00f226d-0b7f-4999-89cc-c50802246c40 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:44.932688 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-a00f226d-0b7f-4999-89cc-c50802246c40 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:44.943248 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-869e59da-15ee-4cff-8746-5c756e9da232 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:44.943851 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-869e59da-15ee-4cff-8746-5c756e9da232 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: de7be542-3f1f-4b34-a68c-4500efe9f8d9] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:51:44.952358 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-869e59da-15ee-4cff-8746-5c756e9da232 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:44.952815 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-869e59da-15ee-4cff-8746-5c756e9da232 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:44.953591 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-869e59da-15ee-4cff-8746-5c756e9da232 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:44.954022 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-869e59da-15ee-4cff-8746-5c756e9da232 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:45.224618 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-a00f226d-0b7f-4999-89cc-c50802246c40 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b08a414e0c45ab839107cccb69f179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb5fe9c67d048c5b2097f9a923ac025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:51:45.229988 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-869e59da-15ee-4cff-8746-5c756e9da232 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68bc45984974d6da1c9151c21dae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbf5bb7e51d4d2d8594d6d1d3a797a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:51:45.233642 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-a00f226d-0b7f-4999-89cc-c50802246c40 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] 10.222.0.48 "GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d" status: 200 len: 1549 microversion: 2.1 time: 0.319657 Apr 08 02:51:45.234188 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 302/609] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:44 2022] GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d => generated 1549 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:51:45.239262 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-869e59da-15ee-4cff-8746-5c756e9da232 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/de7be542-3f1f-4b34-a68c-4500efe9f8d9" status: 200 len: 1681 microversion: 2.1 time: 0.304450 Apr 08 02:51:45.239262 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 308/610] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:44 2022] GET /compute/v2.1/servers/de7be542-3f1f-4b34-a68c-4500efe9f8d9 => generated 1681 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:51:45.784435 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-e60a20cc-7b0c-40ff-a3f2-f255b8ccadcb tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:45.784986 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-e60a20cc-7b0c-40ff-a3f2-f255b8ccadcb tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 19ff8616-8e62-40fe-87e7-f976433b9288] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:51:45.792641 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-e60a20cc-7b0c-40ff-a3f2-f255b8ccadcb tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:45.792641 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-e60a20cc-7b0c-40ff-a3f2-f255b8ccadcb tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:45.793361 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-e60a20cc-7b0c-40ff-a3f2-f255b8ccadcb tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:45.793792 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-e60a20cc-7b0c-40ff-a3f2-f255b8ccadcb tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:45.991679 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-e60a20cc-7b0c-40ff-a3f2-f255b8ccadcb tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a88a8d7c9e4d0a88308c0e894570be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c31bb4f3ce486591bc142b1da7553e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:51:46.000541 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-e60a20cc-7b0c-40ff-a3f2-f255b8ccadcb tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288" status: 200 len: 1675 microversion: 2.1 time: 0.225873 Apr 08 02:51:46.001103 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 303/611] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:45 2022] GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288 => generated 1675 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:51:46.262854 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-2a1954c3-73a5-4a63-81fb-01bbfdd80735 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:46.263467 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-2a1954c3-73a5-4a63-81fb-01bbfdd80735 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: de7be542-3f1f-4b34-a68c-4500efe9f8d9] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:51:46.270549 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-2a1954c3-73a5-4a63-81fb-01bbfdd80735 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:46.271031 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-2a1954c3-73a5-4a63-81fb-01bbfdd80735 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:46.271801 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-2a1954c3-73a5-4a63-81fb-01bbfdd80735 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:46.272233 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-2a1954c3-73a5-4a63-81fb-01bbfdd80735 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:46.409664 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-2a1954c3-73a5-4a63-81fb-01bbfdd80735 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68bc45984974d6da1c9151c21dae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbf5bb7e51d4d2d8594d6d1d3a797a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:51:46.418441 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-2a1954c3-73a5-4a63-81fb-01bbfdd80735 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/de7be542-3f1f-4b34-a68c-4500efe9f8d9" status: 200 len: 1613 microversion: 2.1 time: 0.165561 Apr 08 02:51:46.419218 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 309/612] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:46 2022] GET /compute/v2.1/servers/de7be542-3f1f-4b34-a68c-4500efe9f8d9 => generated 1613 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:51:46.964088 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-0660a9fc-f83e-4fa6-91fd-8dd7e1f27a05 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5a599254-d271-48f0-bf67-3275b6894a86"}} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:51:46.965375 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-0660a9fc-f83e-4fa6-91fd-8dd7e1f27a05 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] [instance: dac91570-d62d-4a3c-a83c-20a727657c9d] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:51:46.984304 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-0660a9fc-f83e-4fa6-91fd-8dd7e1f27a05 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:46.984857 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-0660a9fc-f83e-4fa6-91fd-8dd7e1f27a05 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:46.985867 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-0660a9fc-f83e-4fa6-91fd-8dd7e1f27a05 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:46.990295 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-0660a9fc-f83e-4fa6-91fd-8dd7e1f27a05 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:47.013164 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [req-1012bb03-08e7-4d5f-adf9-24036f5344a4 req-dfba5a4b-93e2-472d-89c5-27c1ac51c6ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de7be542-3f1f-4b34-a68c-4500efe9f8d9", "name": "network-vif-deleted", "tag": "47e2a2ae-5384-4804-b0be-7c736b7e4b92"}]} {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:51:47.025870 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:51:47.025870 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: warnings.warn(msg) Apr 08 02:51:47.038514 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-1012bb03-08e7-4d5f-adf9-24036f5344a4 req-dfba5a4b-93e2-472d-89c5-27c1ac51c6ca service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:47.040165 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-1012bb03-08e7-4d5f-adf9-24036f5344a4 req-dfba5a4b-93e2-472d-89c5-27c1ac51c6ca service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:47.062932 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.compute.server_external_events [req-1012bb03-08e7-4d5f-adf9-24036f5344a4 req-dfba5a4b-93e2-472d-89c5-27c1ac51c6ca service nova] Creating event network-vif-deleted:47e2a2ae-5384-4804-b0be-7c736b7e4b92 for instance de7be542-3f1f-4b34-a68c-4500efe9f8d9 on hv-cinder-83705 Apr 08 02:51:47.068476 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [req-1012bb03-08e7-4d5f-adf9-24036f5344a4 req-dfba5a4b-93e2-472d-89c5-27c1ac51c6ca service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065352 Apr 08 02:51:47.072485 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 310/613] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:51:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 02:51:47.085495 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-d49491b4-5693-4ca6-b0ba-74ed3b4abaf9 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:47.086247 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-d49491b4-5693-4ca6-b0ba-74ed3b4abaf9 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 19ff8616-8e62-40fe-87e7-f976433b9288] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:51:47.095863 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-d49491b4-5693-4ca6-b0ba-74ed3b4abaf9 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:47.096303 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-d49491b4-5693-4ca6-b0ba-74ed3b4abaf9 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:47.097080 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-d49491b4-5693-4ca6-b0ba-74ed3b4abaf9 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:47.097504 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-d49491b4-5693-4ca6-b0ba-74ed3b4abaf9 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:47.449224 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-d49491b4-5693-4ca6-b0ba-74ed3b4abaf9 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a88a8d7c9e4d0a88308c0e894570be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c31bb4f3ce486591bc142b1da7553e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:51:47.470022 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-d49491b4-5693-4ca6-b0ba-74ed3b4abaf9 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288" status: 200 len: 1675 microversion: 2.1 time: 0.395575 Apr 08 02:51:47.471118 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 311/614] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:47 2022] GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288 => generated 1675 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:51:47.487505 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-06f55d77-ff47-40a9-89fa-9d85df22f688 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:47.489198 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-06f55d77-ff47-40a9-89fa-9d85df22f688 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: de7be542-3f1f-4b34-a68c-4500efe9f8d9] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:51:47.490412 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-0660a9fc-f83e-4fa6-91fd-8dd7e1f27a05 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] 10.222.0.48 "POST /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.539693 Apr 08 02:51:47.499526 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-06f55d77-ff47-40a9-89fa-9d85df22f688 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:47.500415 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-06f55d77-ff47-40a9-89fa-9d85df22f688 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:47.501623 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-06f55d77-ff47-40a9-89fa-9d85df22f688 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:47.502530 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-06f55d77-ff47-40a9-89fa-9d85df22f688 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:47.507766 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 304/615] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Apr 8 02:51:46 2022] POST /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d/os-volume_attachments => generated 194 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:51:47.600688 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-06f55d77-ff47-40a9-89fa-9d85df22f688 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:47.601623 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-06f55d77-ff47-40a9-89fa-9d85df22f688 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:47.602082 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.objects.instance [None req-06f55d77-ff47-40a9-89fa-9d85df22f688 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lazy-loading 'fault' on Instance uuid de7be542-3f1f-4b34-a68c-4500efe9f8d9 {{(pid=96920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 08 02:51:47.687904 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-06f55d77-ff47-40a9-89fa-9d85df22f688 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68bc45984974d6da1c9151c21dae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbf5bb7e51d4d2d8594d6d1d3a797a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:51:47.696416 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-06f55d77-ff47-40a9-89fa-9d85df22f688 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/de7be542-3f1f-4b34-a68c-4500efe9f8d9" status: 200 len: 1331 microversion: 2.1 time: 0.223572 Apr 08 02:51:47.697282 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 312/616] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:47 2022] GET /compute/v2.1/servers/de7be542-3f1f-4b34-a68c-4500efe9f8d9 => generated 1331 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:51:48.494782 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-104d2567-d181-4ea9-8179-df20c9e6e09a tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:48.495400 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-104d2567-d181-4ea9-8179-df20c9e6e09a tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 19ff8616-8e62-40fe-87e7-f976433b9288] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:51:48.503442 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-104d2567-d181-4ea9-8179-df20c9e6e09a tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:48.503887 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-104d2567-d181-4ea9-8179-df20c9e6e09a tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:48.504652 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-104d2567-d181-4ea9-8179-df20c9e6e09a tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:48.505083 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-104d2567-d181-4ea9-8179-df20c9e6e09a tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:48.707200 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-104d2567-d181-4ea9-8179-df20c9e6e09a tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a88a8d7c9e4d0a88308c0e894570be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c31bb4f3ce486591bc142b1da7553e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:51:48.715786 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-104d2567-d181-4ea9-8179-df20c9e6e09a tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288" status: 200 len: 1675 microversion: 2.1 time: 0.231317 Apr 08 02:51:48.716307 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 305/617] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:48 2022] GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288 => generated 1675 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:51:48.719140 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-91ef62c4-928f-404c-8f41-33838debd8ae tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:48.719745 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-91ef62c4-928f-404c-8f41-33838debd8ae tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: de7be542-3f1f-4b34-a68c-4500efe9f8d9] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:51:48.726944 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-91ef62c4-928f-404c-8f41-33838debd8ae tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:48.728061 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-91ef62c4-928f-404c-8f41-33838debd8ae tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:48.728832 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-91ef62c4-928f-404c-8f41-33838debd8ae tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:48.729262 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-91ef62c4-928f-404c-8f41-33838debd8ae tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:48.781449 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.wsgi [None req-91ef62c4-928f-404c-8f41-33838debd8ae tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] HTTP exception thrown: Instance de7be542-3f1f-4b34-a68c-4500efe9f8d9 could not be found. Apr 08 02:51:48.782035 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-91ef62c4-928f-404c-8f41-33838debd8ae tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Returning 404 to user: Instance de7be542-3f1f-4b34-a68c-4500efe9f8d9 could not be found. {{(pid=96920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Apr 08 02:51:48.782896 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-91ef62c4-928f-404c-8f41-33838debd8ae tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/de7be542-3f1f-4b34-a68c-4500efe9f8d9" status: 404 len: 111 microversion: 2.1 time: 0.073460 Apr 08 02:51:48.783429 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 313/618] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:48 2022] GET /compute/v2.1/servers/de7be542-3f1f-4b34-a68c-4500efe9f8d9 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 08 02:51:48.796729 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-4b110a30-1b67-4810-889b-c06a506a8e2c tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '.version_select at 0x7f7d4e270af0>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:48.817537 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-4b110a30-1b67-4810-889b-c06a506a8e2c tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1257595415" status: 202 len: 0 microversion: 2.1 time: 0.029582 Apr 08 02:51:48.818070 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 306/619] 10.222.0.48 () {58 vars in 1220 bytes} [Fri Apr 8 02:51:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1257595415 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 02:51:49.738690 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-91ae5074-e9c6-485d-9ec5-e163ce5974ba tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:49.739416 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-91ae5074-e9c6-485d-9ec5-e163ce5974ba tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 19ff8616-8e62-40fe-87e7-f976433b9288] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:51:49.747956 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-91ae5074-e9c6-485d-9ec5-e163ce5974ba tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:49.748647 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-91ae5074-e9c6-485d-9ec5-e163ce5974ba tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:49.749643 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-91ae5074-e9c6-485d-9ec5-e163ce5974ba tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:49.750086 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-91ae5074-e9c6-485d-9ec5-e163ce5974ba tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:49.846101 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-c1415bdf-d951-4684-a89f-f5ad4640ad2d tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:49.846639 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-c1415bdf-d951-4684-a89f-f5ad4640ad2d tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 09e6abc6-19f4-4355-8309-fb3279d9b5e3] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:51:49.855094 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-c1415bdf-d951-4684-a89f-f5ad4640ad2d tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:49.855538 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-c1415bdf-d951-4684-a89f-f5ad4640ad2d tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:49.856310 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-c1415bdf-d951-4684-a89f-f5ad4640ad2d tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:49.856745 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-c1415bdf-d951-4684-a89f-f5ad4640ad2d tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:49.957633 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-91ae5074-e9c6-485d-9ec5-e163ce5974ba tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a88a8d7c9e4d0a88308c0e894570be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c31bb4f3ce486591bc142b1da7553e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:51:49.966200 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-91ae5074-e9c6-485d-9ec5-e163ce5974ba tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288" status: 200 len: 1675 microversion: 2.1 time: 0.236891 Apr 08 02:51:49.966748 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 314/620] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:49 2022] GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288 => generated 1675 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:51:50.102223 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-c1415bdf-d951-4684-a89f-f5ad4640ad2d tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "DELETE /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3/os-volume_attachments/0e193ec0-2248-42d7-8834-e4992c0590f3" status: 202 len: 0 microversion: 2.1 time: 0.265074 Apr 08 02:51:50.103074 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 307/621] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Apr 8 02:51:49 2022] DELETE /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3/os-volume_attachments/0e193ec0-2248-42d7-8834-e4992c0590f3 => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 08 02:51:50.117461 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-4d051990-0f24-43db-bb5b-4871fe67b044 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:50.119319 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-4d051990-0f24-43db-bb5b-4871fe67b044 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 09e6abc6-19f4-4355-8309-fb3279d9b5e3] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:51:50.129122 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-4d051990-0f24-43db-bb5b-4871fe67b044 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:50.129568 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-4d051990-0f24-43db-bb5b-4871fe67b044 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:50.130348 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-4d051990-0f24-43db-bb5b-4871fe67b044 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:50.130817 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-4d051990-0f24-43db-bb5b-4871fe67b044 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:50.206452 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-4d051990-0f24-43db-bb5b-4871fe67b044 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098673 Apr 08 02:51:50.207029 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 315/622] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Apr 8 02:51:50 2022] GET /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:51:50.989463 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-9fe32d81-6f64-443a-9361-7b2b25f990cc tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:50.990141 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-9fe32d81-6f64-443a-9361-7b2b25f990cc tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 19ff8616-8e62-40fe-87e7-f976433b9288] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:51:50.998637 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-9fe32d81-6f64-443a-9361-7b2b25f990cc tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:50.999106 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-9fe32d81-6f64-443a-9361-7b2b25f990cc tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:50.999861 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-9fe32d81-6f64-443a-9361-7b2b25f990cc tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:51.000282 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-9fe32d81-6f64-443a-9361-7b2b25f990cc tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:51.198382 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-9fe32d81-6f64-443a-9361-7b2b25f990cc tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a88a8d7c9e4d0a88308c0e894570be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c31bb4f3ce486591bc142b1da7553e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:51:51.206318 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-9fe32d81-6f64-443a-9361-7b2b25f990cc tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288" status: 200 len: 1675 microversion: 2.1 time: 0.226347 Apr 08 02:51:51.206874 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 308/623] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:50 2022] GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288 => generated 1675 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:51:51.222884 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-58c2f521-c8ef-48db-9c5b-4cd323f6dc05 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:51.223800 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-58c2f521-c8ef-48db-9c5b-4cd323f6dc05 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 09e6abc6-19f4-4355-8309-fb3279d9b5e3] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:51:51.231404 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-58c2f521-c8ef-48db-9c5b-4cd323f6dc05 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:51.231845 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-58c2f521-c8ef-48db-9c5b-4cd323f6dc05 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:51.232601 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-58c2f521-c8ef-48db-9c5b-4cd323f6dc05 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:51.233028 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-58c2f521-c8ef-48db-9c5b-4cd323f6dc05 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:51.300715 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-58c2f521-c8ef-48db-9c5b-4cd323f6dc05 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086991 Apr 08 02:51:51.301249 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 316/624] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Apr 8 02:51:51 2022] GET /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:51:52.229161 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-d24eea4c-a101-4d3e-bb75-f6341d7ba6c8 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:52.229750 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-d24eea4c-a101-4d3e-bb75-f6341d7ba6c8 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 19ff8616-8e62-40fe-87e7-f976433b9288] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:51:52.236877 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-d24eea4c-a101-4d3e-bb75-f6341d7ba6c8 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:52.237312 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-d24eea4c-a101-4d3e-bb75-f6341d7ba6c8 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:52.238068 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-d24eea4c-a101-4d3e-bb75-f6341d7ba6c8 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:52.238494 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-d24eea4c-a101-4d3e-bb75-f6341d7ba6c8 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:52.317588 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-f244ba14-309c-43db-b776-fda3b571e3a7 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:52.318508 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-f244ba14-309c-43db-b776-fda3b571e3a7 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 09e6abc6-19f4-4355-8309-fb3279d9b5e3] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:51:52.325722 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-f244ba14-309c-43db-b776-fda3b571e3a7 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:52.326162 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-f244ba14-309c-43db-b776-fda3b571e3a7 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:52.326967 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-f244ba14-309c-43db-b776-fda3b571e3a7 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:52.327391 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-f244ba14-309c-43db-b776-fda3b571e3a7 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:52.399941 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-f244ba14-309c-43db-b776-fda3b571e3a7 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090788 Apr 08 02:51:52.400609 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 317/625] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Apr 8 02:51:52 2022] GET /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 02:51:52.443547 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-d24eea4c-a101-4d3e-bb75-f6341d7ba6c8 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a88a8d7c9e4d0a88308c0e894570be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c31bb4f3ce486591bc142b1da7553e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:51:52.452500 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-d24eea4c-a101-4d3e-bb75-f6341d7ba6c8 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288" status: 200 len: 1675 microversion: 2.1 time: 0.232948 Apr 08 02:51:52.453028 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 309/626] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:52 2022] GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288 => generated 1675 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:51:53.416040 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-06770c9b-b8c7-4a92-9bc2-ee607ca7c393 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:53.416955 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-06770c9b-b8c7-4a92-9bc2-ee607ca7c393 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 09e6abc6-19f4-4355-8309-fb3279d9b5e3] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:51:53.424096 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-06770c9b-b8c7-4a92-9bc2-ee607ca7c393 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:53.424537 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-06770c9b-b8c7-4a92-9bc2-ee607ca7c393 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:53.425288 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-06770c9b-b8c7-4a92-9bc2-ee607ca7c393 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:53.425714 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-06770c9b-b8c7-4a92-9bc2-ee607ca7c393 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:53.474367 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-deae5b8e-ee81-4487-b309-1c91315a1975 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:53.475002 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-deae5b8e-ee81-4487-b309-1c91315a1975 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 19ff8616-8e62-40fe-87e7-f976433b9288] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:51:53.482281 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-deae5b8e-ee81-4487-b309-1c91315a1975 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:53.482762 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-deae5b8e-ee81-4487-b309-1c91315a1975 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:53.483562 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-deae5b8e-ee81-4487-b309-1c91315a1975 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:53.483994 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-deae5b8e-ee81-4487-b309-1c91315a1975 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:53.494789 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-06770c9b-b8c7-4a92-9bc2-ee607ca7c393 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087835 Apr 08 02:51:53.495347 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 318/627] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Apr 8 02:51:53 2022] GET /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:51:53.681344 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-deae5b8e-ee81-4487-b309-1c91315a1975 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a88a8d7c9e4d0a88308c0e894570be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c31bb4f3ce486591bc142b1da7553e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:51:53.689071 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-deae5b8e-ee81-4487-b309-1c91315a1975 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288" status: 200 len: 1675 microversion: 2.1 time: 0.223697 Apr 08 02:51:53.689598 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 310/628] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:53 2022] GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288 => generated 1675 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:51:54.512698 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-18ba2420-58de-4a2c-95f0-b797f323551a tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:54.513618 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-18ba2420-58de-4a2c-95f0-b797f323551a tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 09e6abc6-19f4-4355-8309-fb3279d9b5e3] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:51:54.520846 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-18ba2420-58de-4a2c-95f0-b797f323551a tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:54.521449 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-18ba2420-58de-4a2c-95f0-b797f323551a tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:54.522326 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-18ba2420-58de-4a2c-95f0-b797f323551a tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:54.522817 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-18ba2420-58de-4a2c-95f0-b797f323551a tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:54.592941 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-18ba2420-58de-4a2c-95f0-b797f323551a tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090191 Apr 08 02:51:54.593496 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 319/629] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Apr 8 02:51:54 2022] GET /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 02:51:54.711685 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-c2c78fb2-d7da-4d6c-9fbe-2540942c9a7e tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:54.712253 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-c2c78fb2-d7da-4d6c-9fbe-2540942c9a7e tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 19ff8616-8e62-40fe-87e7-f976433b9288] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:51:54.719226 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-c2c78fb2-d7da-4d6c-9fbe-2540942c9a7e tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:54.719660 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-c2c78fb2-d7da-4d6c-9fbe-2540942c9a7e tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:54.720413 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-c2c78fb2-d7da-4d6c-9fbe-2540942c9a7e tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:54.720838 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-c2c78fb2-d7da-4d6c-9fbe-2540942c9a7e tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:54.921041 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-c2c78fb2-d7da-4d6c-9fbe-2540942c9a7e tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a88a8d7c9e4d0a88308c0e894570be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c31bb4f3ce486591bc142b1da7553e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:51:54.928942 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-c2c78fb2-d7da-4d6c-9fbe-2540942c9a7e tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288" status: 200 len: 1675 microversion: 2.1 time: 0.226282 Apr 08 02:51:54.929465 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 311/630] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:54 2022] GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288 => generated 1675 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:51:55.366599 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-138e5e02-600b-49c5-a752-08ce2b4a0164 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:55.367234 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-138e5e02-600b-49c5-a752-08ce2b4a0164 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] [instance: dac91570-d62d-4a3c-a83c-20a727657c9d] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:51:55.374499 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-138e5e02-600b-49c5-a752-08ce2b4a0164 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:55.374972 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-138e5e02-600b-49c5-a752-08ce2b4a0164 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:55.375735 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-138e5e02-600b-49c5-a752-08ce2b4a0164 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:55.376159 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-138e5e02-600b-49c5-a752-08ce2b4a0164 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:55.597405 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-138e5e02-600b-49c5-a752-08ce2b4a0164 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b08a414e0c45ab839107cccb69f179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb5fe9c67d048c5b2097f9a923ac025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:51:55.606512 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-138e5e02-600b-49c5-a752-08ce2b4a0164 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] 10.222.0.48 "GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d" status: 200 len: 1595 microversion: 2.1 time: 0.248743 Apr 08 02:51:55.607142 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 320/631] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:55 2022] GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d => generated 1595 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:51:55.610305 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-2945d1c2-b794-41c8-9973-1f0e33753e17 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:55.611315 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-2945d1c2-b794-41c8-9973-1f0e33753e17 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 09e6abc6-19f4-4355-8309-fb3279d9b5e3] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:51:55.619622 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-2945d1c2-b794-41c8-9973-1f0e33753e17 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:55.620066 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-2945d1c2-b794-41c8-9973-1f0e33753e17 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:55.621354 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-2945d1c2-b794-41c8-9973-1f0e33753e17 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:55.621776 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-2945d1c2-b794-41c8-9973-1f0e33753e17 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:55.691494 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-2945d1c2-b794-41c8-9973-1f0e33753e17 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.090983 Apr 08 02:51:55.692036 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 312/632] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Apr 8 02:51:55 2022] GET /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3/os-volume_attachments => generated 25 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 08 02:51:55.785174 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-c95ebc3b-3b5d-4194-bacc-eef48ea50316 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:55.785669 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-c95ebc3b-3b5d-4194-bacc-eef48ea50316 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 09e6abc6-19f4-4355-8309-fb3279d9b5e3] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:51:55.794049 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c95ebc3b-3b5d-4194-bacc-eef48ea50316 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:55.794561 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c95ebc3b-3b5d-4194-bacc-eef48ea50316 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:55.795410 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c95ebc3b-3b5d-4194-bacc-eef48ea50316 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:55.795878 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c95ebc3b-3b5d-4194-bacc-eef48ea50316 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:55.864266 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-c95ebc3b-3b5d-4194-bacc-eef48ea50316 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 09e6abc6-19f4-4355-8309-fb3279d9b5e3] Going to try to terminate instance {{(pid=96920) delete /opt/stack/nova/nova/compute/api.py:2559}} Apr 08 02:51:55.954285 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-21bf37e9-1fe1-404c-8e75-365704fd6f68 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:55.955314 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-21bf37e9-1fe1-404c-8e75-365704fd6f68 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 19ff8616-8e62-40fe-87e7-f976433b9288] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:51:55.964946 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-21bf37e9-1fe1-404c-8e75-365704fd6f68 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:55.966847 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-21bf37e9-1fe1-404c-8e75-365704fd6f68 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:55.968393 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-21bf37e9-1fe1-404c-8e75-365704fd6f68 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:55.969337 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-21bf37e9-1fe1-404c-8e75-365704fd6f68 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:55.992420 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-c95ebc3b-3b5d-4194-bacc-eef48ea50316 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "DELETE /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3" status: 204 len: 0 microversion: 2.1 time: 0.215805 Apr 08 02:51:55.994232 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 321/633] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Apr 8 02:51:55 2022] DELETE /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 08 02:51:56.008535 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-b6689a09-8d04-4f61-9f76-1f6835ac04df tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:56.009645 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-b6689a09-8d04-4f61-9f76-1f6835ac04df tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 09e6abc6-19f4-4355-8309-fb3279d9b5e3] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:51:56.017560 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b6689a09-8d04-4f61-9f76-1f6835ac04df tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:56.018215 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b6689a09-8d04-4f61-9f76-1f6835ac04df tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:56.019190 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b6689a09-8d04-4f61-9f76-1f6835ac04df tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:56.019783 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b6689a09-8d04-4f61-9f76-1f6835ac04df tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:56.293199 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-21bf37e9-1fe1-404c-8e75-365704fd6f68 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a88a8d7c9e4d0a88308c0e894570be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c31bb4f3ce486591bc142b1da7553e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:51:56.297475 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-b6689a09-8d04-4f61-9f76-1f6835ac04df tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68bc45984974d6da1c9151c21dae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbf5bb7e51d4d2d8594d6d1d3a797a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:51:56.301935 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-21bf37e9-1fe1-404c-8e75-365704fd6f68 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288" status: 200 len: 1675 microversion: 2.1 time: 0.359606 Apr 08 02:51:56.302596 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 313/634] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:55 2022] GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288 => generated 1675 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:51:56.306100 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-b6689a09-8d04-4f61-9f76-1f6835ac04df tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3" status: 200 len: 1679 microversion: 2.1 time: 0.307589 Apr 08 02:51:56.307105 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 322/635] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:55 2022] GET /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3 => generated 1679 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:51:57.324993 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-ae2642b0-001e-4801-b5d8-28a5bfb222a6 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:57.325772 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-ae2642b0-001e-4801-b5d8-28a5bfb222a6 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 19ff8616-8e62-40fe-87e7-f976433b9288] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:51:57.329121 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-48d4b032-53eb-47f3-904e-17da5a9a0694 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:57.329721 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-48d4b032-53eb-47f3-904e-17da5a9a0694 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 09e6abc6-19f4-4355-8309-fb3279d9b5e3] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:51:57.333464 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ae2642b0-001e-4801-b5d8-28a5bfb222a6 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:57.334213 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ae2642b0-001e-4801-b5d8-28a5bfb222a6 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:57.335139 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ae2642b0-001e-4801-b5d8-28a5bfb222a6 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:57.335691 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ae2642b0-001e-4801-b5d8-28a5bfb222a6 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:57.338074 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-48d4b032-53eb-47f3-904e-17da5a9a0694 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:57.338509 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-48d4b032-53eb-47f3-904e-17da5a9a0694 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:57.339309 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-48d4b032-53eb-47f3-904e-17da5a9a0694 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:57.339727 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-48d4b032-53eb-47f3-904e-17da5a9a0694 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:57.636227 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-ae2642b0-001e-4801-b5d8-28a5bfb222a6 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a88a8d7c9e4d0a88308c0e894570be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c31bb4f3ce486591bc142b1da7553e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:51:57.643149 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-48d4b032-53eb-47f3-904e-17da5a9a0694 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68bc45984974d6da1c9151c21dae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbf5bb7e51d4d2d8594d6d1d3a797a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:51:57.645110 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-ae2642b0-001e-4801-b5d8-28a5bfb222a6 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288" status: 200 len: 1675 microversion: 2.1 time: 0.329970 Apr 08 02:51:57.646767 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 314/636] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:57 2022] GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288 => generated 1675 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:51:57.653692 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-48d4b032-53eb-47f3-904e-17da5a9a0694 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3" status: 200 len: 1679 microversion: 2.1 time: 0.334396 Apr 08 02:51:57.654497 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 323/637] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:57 2022] GET /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3 => generated 1679 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:51:58.669533 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-7f005e32-c74c-49d2-ac69-75a8e8ed9f07 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:58.670288 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-7f005e32-c74c-49d2-ac69-75a8e8ed9f07 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 19ff8616-8e62-40fe-87e7-f976433b9288] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:51:58.676720 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-553a7117-3c98-4cab-a1cb-fc89e5997b8e tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:58.677332 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-553a7117-3c98-4cab-a1cb-fc89e5997b8e tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 09e6abc6-19f4-4355-8309-fb3279d9b5e3] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:51:58.678143 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-7f005e32-c74c-49d2-ac69-75a8e8ed9f07 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:58.678704 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-7f005e32-c74c-49d2-ac69-75a8e8ed9f07 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:58.679583 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-7f005e32-c74c-49d2-ac69-75a8e8ed9f07 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:58.681080 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-7f005e32-c74c-49d2-ac69-75a8e8ed9f07 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:58.686690 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-553a7117-3c98-4cab-a1cb-fc89e5997b8e tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:58.686946 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-553a7117-3c98-4cab-a1cb-fc89e5997b8e tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:58.687931 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-553a7117-3c98-4cab-a1cb-fc89e5997b8e tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:58.688351 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-553a7117-3c98-4cab-a1cb-fc89e5997b8e tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:58.851441 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-553a7117-3c98-4cab-a1cb-fc89e5997b8e tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68bc45984974d6da1c9151c21dae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbf5bb7e51d4d2d8594d6d1d3a797a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:51:58.860963 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-553a7117-3c98-4cab-a1cb-fc89e5997b8e tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3" status: 200 len: 1612 microversion: 2.1 time: 0.193314 Apr 08 02:51:58.862381 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 324/638] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:58 2022] GET /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3 => generated 1612 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:51:58.933702 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-7f005e32-c74c-49d2-ac69-75a8e8ed9f07 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a88a8d7c9e4d0a88308c0e894570be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c31bb4f3ce486591bc142b1da7553e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:51:58.941814 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-7f005e32-c74c-49d2-ac69-75a8e8ed9f07 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288" status: 200 len: 1652 microversion: 2.1 time: 0.282299 Apr 08 02:51:58.942550 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 315/639] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:58 2022] GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288 => generated 1652 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:51:58.965024 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-09210b86-b090-4a10-9984-d672ee3b65ae tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:51:58.973149 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-09210b86-b090-4a10-9984-d672ee3b65ae tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:58.973814 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-09210b86-b090-4a10-9984-d672ee3b65ae tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:59.045257 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-09210b86-b090-4a10-9984-d672ee3b65ae tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 19ff8616-8e62-40fe-87e7-f976433b9288] Going to try to start instance {{(pid=96920) start /opt/stack/nova/nova/compute/api.py:2622}} Apr 08 02:51:59.130022 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-09210b86-b090-4a10-9984-d672ee3b65ae tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "POST /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288/action" status: 202 len: 0 microversion: 2.1 time: 0.175153 Apr 08 02:51:59.130616 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 325/640] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Apr 8 02:51:58 2022] POST /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 02:51:59.144413 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-69b1c792-fd03-4f90-ab9f-ec7d6ee8b624 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:59.145272 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-69b1c792-fd03-4f90-ab9f-ec7d6ee8b624 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 19ff8616-8e62-40fe-87e7-f976433b9288] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:51:59.154614 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-69b1c792-fd03-4f90-ab9f-ec7d6ee8b624 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:59.155186 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-69b1c792-fd03-4f90-ab9f-ec7d6ee8b624 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:59.155966 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-69b1c792-fd03-4f90-ab9f-ec7d6ee8b624 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:59.156415 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-69b1c792-fd03-4f90-ab9f-ec7d6ee8b624 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:59.374010 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-69b1c792-fd03-4f90-ab9f-ec7d6ee8b624 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a88a8d7c9e4d0a88308c0e894570be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c31bb4f3ce486591bc142b1da7553e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:51:59.382383 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-69b1c792-fd03-4f90-ab9f-ec7d6ee8b624 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288" status: 200 len: 1661 microversion: 2.1 time: 0.247460 Apr 08 02:51:59.382949 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 316/641] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:59 2022] GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288 => generated 1661 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:51:59.747382 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [req-665215b5-aab0-4f34-80d7-b0eaaaf8e691 req-d02660fa-d12b-4834-8e92-cb11ba457a94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09e6abc6-19f4-4355-8309-fb3279d9b5e3", "name": "network-vif-deleted", "tag": "b5e78270-c26b-4b02-a6c8-efffc69a4c3c"}]} {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:51:59.770377 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:51:59.770377 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: warnings.warn(msg) Apr 08 02:51:59.795631 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-665215b5-aab0-4f34-80d7-b0eaaaf8e691 req-d02660fa-d12b-4834-8e92-cb11ba457a94 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:59.798889 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-665215b5-aab0-4f34-80d7-b0eaaaf8e691 req-d02660fa-d12b-4834-8e92-cb11ba457a94 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:59.848320 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.compute.server_external_events [req-665215b5-aab0-4f34-80d7-b0eaaaf8e691 req-d02660fa-d12b-4834-8e92-cb11ba457a94 service nova] Creating event network-vif-deleted:b5e78270-c26b-4b02-a6c8-efffc69a4c3c for instance 09e6abc6-19f4-4355-8309-fb3279d9b5e3 on hv-cinder-83705 Apr 08 02:51:59.859569 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [req-665215b5-aab0-4f34-80d7-b0eaaaf8e691 req-d02660fa-d12b-4834-8e92-cb11ba457a94 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145757 Apr 08 02:51:59.860439 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 326/642] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:51:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:51:59.886800 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-e2c87cc1-b74e-4faf-935b-a468746ffe27 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:51:59.887676 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-e2c87cc1-b74e-4faf-935b-a468746ffe27 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 09e6abc6-19f4-4355-8309-fb3279d9b5e3] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:51:59.914151 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-e2c87cc1-b74e-4faf-935b-a468746ffe27 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:59.915740 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-e2c87cc1-b74e-4faf-935b-a468746ffe27 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:51:59.916733 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-e2c87cc1-b74e-4faf-935b-a468746ffe27 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:51:59.917767 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-e2c87cc1-b74e-4faf-935b-a468746ffe27 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:00.120923 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-e2c87cc1-b74e-4faf-935b-a468746ffe27 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:00.123242 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-e2c87cc1-b74e-4faf-935b-a468746ffe27 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:00.125635 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.objects.instance [None req-e2c87cc1-b74e-4faf-935b-a468746ffe27 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lazy-loading 'fault' on Instance uuid 09e6abc6-19f4-4355-8309-fb3279d9b5e3 {{(pid=96919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 08 02:52:00.201218 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-e2c87cc1-b74e-4faf-935b-a468746ffe27 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68bc45984974d6da1c9151c21dae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbf5bb7e51d4d2d8594d6d1d3a797a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:52:00.226249 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-e2c87cc1-b74e-4faf-935b-a468746ffe27 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3" status: 200 len: 1330 microversion: 2.1 time: 0.350279 Apr 08 02:52:00.230711 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 317/643] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:51:59 2022] GET /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3 => generated 1330 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:52:00.410140 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-0784d69e-662d-4d30-845f-b6a40f163aca tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:00.411031 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-0784d69e-662d-4d30-845f-b6a40f163aca tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 19ff8616-8e62-40fe-87e7-f976433b9288] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:52:00.433949 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-0784d69e-662d-4d30-845f-b6a40f163aca tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:00.434428 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-0784d69e-662d-4d30-845f-b6a40f163aca tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:00.442712 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-0784d69e-662d-4d30-845f-b6a40f163aca tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:00.443168 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-0784d69e-662d-4d30-845f-b6a40f163aca tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:00.786010 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-0784d69e-662d-4d30-845f-b6a40f163aca tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a88a8d7c9e4d0a88308c0e894570be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c31bb4f3ce486591bc142b1da7553e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:52:00.797534 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-0784d69e-662d-4d30-845f-b6a40f163aca tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288" status: 200 len: 1661 microversion: 2.1 time: 0.400662 Apr 08 02:52:00.807276 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 327/644] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:52:00 2022] GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288 => generated 1661 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:52:01.250203 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-e852e98a-80fe-4a34-99ed-14042b4d8265 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:01.251558 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-e852e98a-80fe-4a34-99ed-14042b4d8265 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 09e6abc6-19f4-4355-8309-fb3279d9b5e3] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:52:01.259468 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-e852e98a-80fe-4a34-99ed-14042b4d8265 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:01.259999 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-e852e98a-80fe-4a34-99ed-14042b4d8265 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:01.261067 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-e852e98a-80fe-4a34-99ed-14042b4d8265 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:01.261573 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-e852e98a-80fe-4a34-99ed-14042b4d8265 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:01.315776 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.wsgi [None req-e852e98a-80fe-4a34-99ed-14042b4d8265 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] HTTP exception thrown: Instance 09e6abc6-19f4-4355-8309-fb3279d9b5e3 could not be found. Apr 08 02:52:01.316609 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-e852e98a-80fe-4a34-99ed-14042b4d8265 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Returning 404 to user: Instance 09e6abc6-19f4-4355-8309-fb3279d9b5e3 could not be found. {{(pid=96919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Apr 08 02:52:01.317446 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-e852e98a-80fe-4a34-99ed-14042b4d8265 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3" status: 404 len: 111 microversion: 2.1 time: 0.077115 Apr 08 02:52:01.318000 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 318/645] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:52:01 2022] GET /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 02:52:01.332476 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-9d7d1ec1-ce0a-4486-9158-d70883672bcb tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '.version_select at 0x7f7d4e2afee0>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:01.359230 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-9d7d1ec1-ce0a-4486-9158-d70883672bcb tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-89554807" status: 202 len: 0 microversion: 2.1 time: 0.036081 Apr 08 02:52:01.360073 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 328/646] 10.222.0.48 () {58 vars in 1214 bytes} [Fri Apr 8 02:52:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-89554807 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 02:52:01.370583 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-182819dc-deaf-4aff-866f-1558c6ee1ef9 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1211889029"}} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:52:01.371144 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-182819dc-deaf-4aff-866f-1558c6ee1ef9 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] [instance: dac91570-d62d-4a3c-a83c-20a727657c9d] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:52:01.378420 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-182819dc-deaf-4aff-866f-1558c6ee1ef9 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:01.379272 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-182819dc-deaf-4aff-866f-1558c6ee1ef9 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:01.380047 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-182819dc-deaf-4aff-866f-1558c6ee1ef9 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:01.380474 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-182819dc-deaf-4aff-866f-1558c6ee1ef9 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:01.612384 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.network.security_group_api [None req-182819dc-deaf-4aff-866f-1558c6ee1ef9 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Adding security group e7f5e98b-b52c-4ae3-83e9-21cfe12d42de to port f7bd9446-7011-458c-94be-2eb73cc73b68 Apr 08 02:52:01.821895 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-aa48d126-5a8c-4415-9ee0-c371b464ed70 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:01.822577 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-aa48d126-5a8c-4415-9ee0-c371b464ed70 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 19ff8616-8e62-40fe-87e7-f976433b9288] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:52:01.830801 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-aa48d126-5a8c-4415-9ee0-c371b464ed70 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:01.831241 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-aa48d126-5a8c-4415-9ee0-c371b464ed70 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:01.832007 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-aa48d126-5a8c-4415-9ee0-c371b464ed70 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:01.832428 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-aa48d126-5a8c-4415-9ee0-c371b464ed70 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:02.190132 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-aa48d126-5a8c-4415-9ee0-c371b464ed70 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a88a8d7c9e4d0a88308c0e894570be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c31bb4f3ce486591bc142b1da7553e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:52:02.200064 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-182819dc-deaf-4aff-866f-1558c6ee1ef9 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] 10.222.0.48 "POST /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d/action" status: 202 len: 0 microversion: 2.1 time: 0.844462 Apr 08 02:52:02.200972 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 319/647] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Apr 8 02:52:01 2022] POST /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d/action => generated 0 bytes in 846 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 02:52:02.201820 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-aa48d126-5a8c-4415-9ee0-c371b464ed70 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288" status: 200 len: 1665 microversion: 2.1 time: 0.389650 Apr 08 02:52:02.202983 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 329/648] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:52:01 2022] GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288 => generated 1665 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:52:02.210983 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [req-469d7e30-b4ba-43b3-863e-4dd8931be43e req-bbf9d123-9fb5-4136-8648-777b5a649a47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dac91570-d62d-4a3c-a83c-20a727657c9d", "tag": "f7bd9446-7011-458c-94be-2eb73cc73b68"}]} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:52:02.217874 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-c0d56867-a928-49f3-b6d6-b3caad066f74 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:02.221113 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-c0d56867-a928-49f3-b6d6-b3caad066f74 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] [instance: dac91570-d62d-4a3c-a83c-20a727657c9d] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:52:02.230280 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:52:02.230280 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: warnings.warn(msg) Apr 08 02:52:02.232350 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c0d56867-a928-49f3-b6d6-b3caad066f74 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:02.234141 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c0d56867-a928-49f3-b6d6-b3caad066f74 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:02.235050 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c0d56867-a928-49f3-b6d6-b3caad066f74 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:02.238539 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c0d56867-a928-49f3-b6d6-b3caad066f74 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:02.243023 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-469d7e30-b4ba-43b3-863e-4dd8931be43e req-bbf9d123-9fb5-4136-8648-777b5a649a47 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:02.243458 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-469d7e30-b4ba-43b3-863e-4dd8931be43e req-bbf9d123-9fb5-4136-8648-777b5a649a47 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:02.267731 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.compute.server_external_events [req-469d7e30-b4ba-43b3-863e-4dd8931be43e req-bbf9d123-9fb5-4136-8648-777b5a649a47 service nova] Creating event network-changed:f7bd9446-7011-458c-94be-2eb73cc73b68 for instance dac91570-d62d-4a3c-a83c-20a727657c9d on hv-cinder-83705 Apr 08 02:52:02.274697 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [req-469d7e30-b4ba-43b3-863e-4dd8931be43e req-bbf9d123-9fb5-4136-8648-777b5a649a47 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071865 Apr 08 02:52:02.277825 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 320/649] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:52:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:52:02.289022 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [req-1dd7a134-ceb6-4c53-867e-9469c5d0c4e7 req-20b4b469-4684-41e3-8649-c8969c5672c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dac91570-d62d-4a3c-a83c-20a727657c9d", "tag": "f7bd9446-7011-458c-94be-2eb73cc73b68"}]} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:52:02.297029 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:52:02.297029 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: warnings.warn(msg) Apr 08 02:52:02.307255 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-1dd7a134-ceb6-4c53-867e-9469c5d0c4e7 req-20b4b469-4684-41e3-8649-c8969c5672c2 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:02.307931 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-1dd7a134-ceb6-4c53-867e-9469c5d0c4e7 req-20b4b469-4684-41e3-8649-c8969c5672c2 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:02.330050 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.compute.server_external_events [req-1dd7a134-ceb6-4c53-867e-9469c5d0c4e7 req-20b4b469-4684-41e3-8649-c8969c5672c2 service nova] Creating event network-changed:f7bd9446-7011-458c-94be-2eb73cc73b68 for instance dac91570-d62d-4a3c-a83c-20a727657c9d on hv-cinder-83705 Apr 08 02:52:02.337928 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [req-1dd7a134-ceb6-4c53-867e-9469c5d0c4e7 req-20b4b469-4684-41e3-8649-c8969c5672c2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058393 Apr 08 02:52:02.341293 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 321/650] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:52:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:52:02.543035 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-c0d56867-a928-49f3-b6d6-b3caad066f74 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b08a414e0c45ab839107cccb69f179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb5fe9c67d048c5b2097f9a923ac025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:52:02.552755 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-c0d56867-a928-49f3-b6d6-b3caad066f74 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] 10.222.0.48 "GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d" status: 200 len: 1642 microversion: 2.1 time: 0.347988 Apr 08 02:52:02.553683 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 330/651] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:52:02 2022] GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d => generated 1642 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:52:02.743344 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-aafca9f5-b174-4631-a8c6-4771ebb638e2 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Action: 'create', calling method: .version_select at 0x7f7d4e31f430>, body: {"keypair": {"name": "tempest-keypair-1816110086"}} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:52:02.772293 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.quota [None req-aafca9f5-b174-4631-a8c6-4771ebb638e2 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Getting quotas for project cbbf5bb7e51d4d2d8594d6d1d3a797a3. Resources: {'key_pairs'} {{(pid=96919) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:52:02.776559 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.quota [None req-aafca9f5-b174-4631-a8c6-4771ebb638e2 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Getting quotas for user b68bc45984974d6da1c9151c21dae14c and project cbbf5bb7e51d4d2d8594d6d1d3a797a3. Resources: {'key_pairs'} {{(pid=96919) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:52:02.949288 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.quota [None req-aafca9f5-b174-4631-a8c6-4771ebb638e2 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Getting quotas for project cbbf5bb7e51d4d2d8594d6d1d3a797a3. Resources: {'key_pairs'} {{(pid=96919) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:52:02.953584 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.quota [None req-aafca9f5-b174-4631-a8c6-4771ebb638e2 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Getting quotas for user b68bc45984974d6da1c9151c21dae14c and project cbbf5bb7e51d4d2d8594d6d1d3a797a3. Resources: {'key_pairs'} {{(pid=96919) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:52:02.968577 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-aafca9f5-b174-4631-a8c6-4771ebb638e2 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.238461 Apr 08 02:52:02.969717 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 322/652] 10.222.0.48 () {60 vars in 1157 bytes} [Fri Apr 8 02:52:02 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:52:04.529452 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a7de49e6-731f-4613-b4f9-e7f4456e292e] AMQP server on 10.222.0.48:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 08 02:52:04.538233 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-16c552be-cc27-45b1-a442-e3edc58ea359 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:04.538737 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-16c552be-cc27-45b1-a442-e3edc58ea359 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:52:04.545957 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-16c552be-cc27-45b1-a442-e3edc58ea359 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:04.546458 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-16c552be-cc27-45b1-a442-e3edc58ea359 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:04.547271 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-16c552be-cc27-45b1-a442-e3edc58ea359 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:04.547700 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-16c552be-cc27-45b1-a442-e3edc58ea359 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:04.617775 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-16c552be-cc27-45b1-a442-e3edc58ea359 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf/os-volume_attachments/55a712a3-452d-472b-bfc7-ec66a9031da4" status: 200 len: 194 microversion: 2.20 time: 0.089584 Apr 08 02:52:04.618476 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 331/653] 10.222.0.48 () {60 vars in 1453 bytes} [Fri Apr 8 02:52:04 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf/os-volume_attachments/55a712a3-452d-472b-bfc7-ec66a9031da4 => generated 194 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 02:52:04.722743 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-933c2171-6de5-4e79-b966-b7e73b5fb2fe tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:04.723444 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-933c2171-6de5-4e79-b966-b7e73b5fb2fe tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:52:04.731053 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-933c2171-6de5-4e79-b966-b7e73b5fb2fe tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:04.731495 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-933c2171-6de5-4e79-b966-b7e73b5fb2fe tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:04.732264 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-933c2171-6de5-4e79-b966-b7e73b5fb2fe tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:04.732692 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-933c2171-6de5-4e79-b966-b7e73b5fb2fe tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:04.747334 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-6c5ea715-54e9-4db9-aa07-520fab7cbcb3 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-946786783", "imageRef": "7f8ca061-f382-4052-8d05-69f37e107684", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8b5bf61a-9182-47e6-a758-1a71619fdd20"}], "security_groups": [{"name": "tempest-securitygroup--872103495"}], "key_name": "tempest-keypair-1816110086", "user_data": "}} {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:52:04.882918 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.network.neutron [None req-6c5ea715-54e9-4db9-aa07-520fab7cbcb3 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] validate_networks() for [('8b5bf61a-9182-47e6-a758-1a71619fdd20', None, None, None)] {{(pid=96920) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} Apr 08 02:52:04.972857 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-933c2171-6de5-4e79-b966-b7e73b5fb2fe tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf/os-volume_attachments/55a712a3-452d-472b-bfc7-ec66a9031da4" status: 202 len: 0 microversion: 2.20 time: 0.259603 Apr 08 02:52:04.973435 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 323/654] 10.222.0.48 () {60 vars in 1456 bytes} [Fri Apr 8 02:52:04 2022] DELETE /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf/os-volume_attachments/55a712a3-452d-472b-bfc7-ec66a9031da4 => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 08 02:52:04.991919 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-53e0c35d-8095-4d0c-bf1d-f342697d5303 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:04.992953 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-53e0c35d-8095-4d0c-bf1d-f342697d5303 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:52:05.001633 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-53e0c35d-8095-4d0c-bf1d-f342697d5303 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:05.002098 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-53e0c35d-8095-4d0c-bf1d-f342697d5303 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:05.002895 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-53e0c35d-8095-4d0c-bf1d-f342697d5303 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:05.003348 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-53e0c35d-8095-4d0c-bf1d-f342697d5303 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:05.078840 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-53e0c35d-8095-4d0c-bf1d-f342697d5303 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.099954 Apr 08 02:52:05.082735 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 324/655] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Apr 8 02:52:04 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 08 02:52:05.402972 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.virt.hardware [None req-6c5ea715-54e9-4db9-aa07-520fab7cbcb3 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Flavor limits 0:0:0 {{(pid=96920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} Apr 08 02:52:05.403420 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.virt.hardware [None req-6c5ea715-54e9-4db9-aa07-520fab7cbcb3 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Image limits 0:0:0 {{(pid=96920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} Apr 08 02:52:05.403883 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.virt.hardware [None req-6c5ea715-54e9-4db9-aa07-520fab7cbcb3 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Flavor pref 0:0:0 {{(pid=96920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} Apr 08 02:52:05.404282 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.virt.hardware [None req-6c5ea715-54e9-4db9-aa07-520fab7cbcb3 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Image pref 0:0:0 {{(pid=96920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} Apr 08 02:52:05.404685 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.virt.hardware [None req-6c5ea715-54e9-4db9-aa07-520fab7cbcb3 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=96920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} Apr 08 02:52:05.412949 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-6c5ea715-54e9-4db9-aa07-520fab7cbcb3 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:05.413364 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-6c5ea715-54e9-4db9-aa07-520fab7cbcb3 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:05.414153 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-6c5ea715-54e9-4db9-aa07-520fab7cbcb3 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:05.415240 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-6c5ea715-54e9-4db9-aa07-520fab7cbcb3 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:05.432300 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.quota [None req-6c5ea715-54e9-4db9-aa07-520fab7cbcb3 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Getting quotas for project cbbf5bb7e51d4d2d8594d6d1d3a797a3. Resources: {'instances', 'cores', 'ram'} {{(pid=96920) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:52:05.436198 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.quota [None req-6c5ea715-54e9-4db9-aa07-520fab7cbcb3 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Getting quotas for user b68bc45984974d6da1c9151c21dae14c and project cbbf5bb7e51d4d2d8594d6d1d3a797a3. Resources: {'instances', 'cores', 'ram'} {{(pid=96920) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:52:05.446512 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-6c5ea715-54e9-4db9-aa07-520fab7cbcb3 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Going to run 1 instances... {{(pid=96920) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} Apr 08 02:52:05.448777 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-6c5ea715-54e9-4db9-aa07-520fab7cbcb3 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 991d0926-dfa5-43b7-a6d4-b745f1bb8e59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7f8ca061-f382-4052-8d05-69f37e107684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=96920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} Apr 08 02:52:05.492781 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-6c5ea715-54e9-4db9-aa07-520fab7cbcb3 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.755326 Apr 08 02:52:05.493363 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 332/656] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Apr 8 02:52:04 2022] POST /compute/v2.1/servers => generated 401 bytes in 757 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 08 02:52:05.509424 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-81743e69-b380-4a3c-b506-db118fd71fad tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:05.510029 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-81743e69-b380-4a3c-b506-db118fd71fad tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 991d0926-dfa5-43b7-a6d4-b745f1bb8e59] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:52:05.596484 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-81743e69-b380-4a3c-b506-db118fd71fad tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68bc45984974d6da1c9151c21dae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbf5bb7e51d4d2d8594d6d1d3a797a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:52:05.604921 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-81743e69-b380-4a3c-b506-db118fd71fad tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/991d0926-dfa5-43b7-a6d4-b745f1bb8e59" status: 200 len: 1241 microversion: 2.1 time: 0.105158 Apr 08 02:52:05.605731 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 325/657] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:52:05 2022] GET /compute/v2.1/servers/991d0926-dfa5-43b7-a6d4-b745f1bb8e59 => generated 1241 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:52:06.096113 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-9c0f62b8-696c-41cc-a8d5-efea03b2b01a tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:06.097090 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-9c0f62b8-696c-41cc-a8d5-efea03b2b01a tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:52:06.117064 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-9c0f62b8-696c-41cc-a8d5-efea03b2b01a tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:06.118146 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-9c0f62b8-696c-41cc-a8d5-efea03b2b01a tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:06.118932 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-9c0f62b8-696c-41cc-a8d5-efea03b2b01a tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:06.119358 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-9c0f62b8-696c-41cc-a8d5-efea03b2b01a tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:06.149302 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO oslo.messaging._drivers.impl_rabbit [-] [a7de49e6-731f-4613-b4f9-e7f4456e292e] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 50864. Apr 08 02:52:06.190867 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-9c0f62b8-696c-41cc-a8d5-efea03b2b01a tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.104004 Apr 08 02:52:06.191401 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 333/658] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Apr 8 02:52:06 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf/os-volume_attachments => generated 25 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:52:06.283404 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-29062b8e-08d2-4849-b6a3-88b152f3859f tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:06.283906 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-29062b8e-08d2-4849-b6a3-88b152f3859f tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:52:06.292467 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-29062b8e-08d2-4849-b6a3-88b152f3859f tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:06.292907 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-29062b8e-08d2-4849-b6a3-88b152f3859f tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:06.293663 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-29062b8e-08d2-4849-b6a3-88b152f3859f tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:06.294089 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-29062b8e-08d2-4849-b6a3-88b152f3859f tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:06.360736 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-29062b8e-08d2-4849-b6a3-88b152f3859f tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Going to try to terminate instance {{(pid=96919) delete /opt/stack/nova/nova/compute/api.py:2559}} Apr 08 02:52:06.473221 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-29062b8e-08d2-4849-b6a3-88b152f3859f tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 204 len: 0 microversion: 2.20 time: 0.198070 Apr 08 02:52:06.474032 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 326/659] 10.222.0.48 () {60 vars in 1279 bytes} [Fri Apr 8 02:52:06 2022] DELETE /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 08 02:52:06.488812 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-173d4795-7c8f-4a62-a96e-6f4ca74b6cd0 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:06.489524 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-173d4795-7c8f-4a62-a96e-6f4ca74b6cd0 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:52:06.499512 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-173d4795-7c8f-4a62-a96e-6f4ca74b6cd0 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:06.500356 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-173d4795-7c8f-4a62-a96e-6f4ca74b6cd0 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:06.501204 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-173d4795-7c8f-4a62-a96e-6f4ca74b6cd0 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:06.501736 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-173d4795-7c8f-4a62-a96e-6f4ca74b6cd0 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:06.628855 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-9a711a40-f0cc-4742-bdc5-5091805352eb tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:06.629858 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-9a711a40-f0cc-4742-bdc5-5091805352eb tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 991d0926-dfa5-43b7-a6d4-b745f1bb8e59] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:52:06.637534 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-9a711a40-f0cc-4742-bdc5-5091805352eb tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:06.638209 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-9a711a40-f0cc-4742-bdc5-5091805352eb tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:06.639168 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-9a711a40-f0cc-4742-bdc5-5091805352eb tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:06.639754 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-9a711a40-f0cc-4742-bdc5-5091805352eb tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:06.787371 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-173d4795-7c8f-4a62-a96e-6f4ca74b6cd0 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:52:06.788614 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-9a711a40-f0cc-4742-bdc5-5091805352eb tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68bc45984974d6da1c9151c21dae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbf5bb7e51d4d2d8594d6d1d3a797a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:52:06.797616 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-9a711a40-f0cc-4742-bdc5-5091805352eb tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/991d0926-dfa5-43b7-a6d4-b745f1bb8e59" status: 200 len: 1311 microversion: 2.1 time: 0.179737 Apr 08 02:52:06.798455 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 327/660] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:52:06 2022] GET /compute/v2.1/servers/991d0926-dfa5-43b7-a6d4-b745f1bb8e59 => generated 1311 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:52:06.816708 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-173d4795-7c8f-4a62-a96e-6f4ca74b6cd0 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:52:06.823875 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-173d4795-7c8f-4a62-a96e-6f4ca74b6cd0 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:52:06.825012 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-173d4795-7c8f-4a62-a96e-6f4ca74b6cd0 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1725 microversion: 2.20 time: 0.345713 Apr 08 02:52:06.825539 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 334/661] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:52:06 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1725 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:52:07.821612 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-6a735d9b-76b8-4b46-a63c-ddd63b20f617 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:07.822388 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-6a735d9b-76b8-4b46-a63c-ddd63b20f617 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 991d0926-dfa5-43b7-a6d4-b745f1bb8e59] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:52:07.829632 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-6a735d9b-76b8-4b46-a63c-ddd63b20f617 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:07.830076 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-6a735d9b-76b8-4b46-a63c-ddd63b20f617 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:07.830876 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-6a735d9b-76b8-4b46-a63c-ddd63b20f617 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:07.831307 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-6a735d9b-76b8-4b46-a63c-ddd63b20f617 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:07.849068 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-68504e08-c3eb-4a69-843f-79f974583eb3 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:07.850512 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-68504e08-c3eb-4a69-843f-79f974583eb3 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:52:07.859175 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-68504e08-c3eb-4a69-843f-79f974583eb3 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:07.859743 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-68504e08-c3eb-4a69-843f-79f974583eb3 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:07.860762 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-68504e08-c3eb-4a69-843f-79f974583eb3 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:07.861505 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-68504e08-c3eb-4a69-843f-79f974583eb3 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:08.143010 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-6a735d9b-76b8-4b46-a63c-ddd63b20f617 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68bc45984974d6da1c9151c21dae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbf5bb7e51d4d2d8594d6d1d3a797a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:52:08.150353 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-68504e08-c3eb-4a69-843f-79f974583eb3 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:52:08.152201 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-6a735d9b-76b8-4b46-a63c-ddd63b20f617 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/991d0926-dfa5-43b7-a6d4-b745f1bb8e59" status: 200 len: 1366 microversion: 2.1 time: 0.340571 Apr 08 02:52:08.152855 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 328/662] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:52:07 2022] GET /compute/v2.1/servers/991d0926-dfa5-43b7-a6d4-b745f1bb8e59 => generated 1366 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:52:08.173616 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-68504e08-c3eb-4a69-843f-79f974583eb3 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:52:08.180220 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-68504e08-c3eb-4a69-843f-79f974583eb3 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:52:08.181517 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-68504e08-c3eb-4a69-843f-79f974583eb3 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1725 microversion: 2.20 time: 0.342027 Apr 08 02:52:08.182219 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 335/663] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:52:07 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1725 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 02:52:08.502911 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [req-83e13b72-426c-467e-b55d-4329db3283a0 req-cb35e019-84b4-470c-a183-05a54ffdf35e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "991d0926-dfa5-43b7-a6d4-b745f1bb8e59", "tag": "91c08498-dc67-4de7-be78-2f9d88554354"}]} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:52:08.509386 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:52:08.509386 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: warnings.warn(msg) Apr 08 02:52:08.520847 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-83e13b72-426c-467e-b55d-4329db3283a0 req-cb35e019-84b4-470c-a183-05a54ffdf35e service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:08.521287 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-83e13b72-426c-467e-b55d-4329db3283a0 req-cb35e019-84b4-470c-a183-05a54ffdf35e service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:08.538698 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.compute.server_external_events [req-83e13b72-426c-467e-b55d-4329db3283a0 req-cb35e019-84b4-470c-a183-05a54ffdf35e service nova] Creating event network-changed:91c08498-dc67-4de7-be78-2f9d88554354 for instance 991d0926-dfa5-43b7-a6d4-b745f1bb8e59 on hv-cinder-83705 Apr 08 02:52:08.544192 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [req-83e13b72-426c-467e-b55d-4329db3283a0 req-cb35e019-84b4-470c-a183-05a54ffdf35e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050886 Apr 08 02:52:08.544785 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 329/664] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:52:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:52:09.173987 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-c6c876f7-d9d9-41fa-9bb2-05c79e6f76ee tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:09.174587 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-c6c876f7-d9d9-41fa-9bb2-05c79e6f76ee tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 991d0926-dfa5-43b7-a6d4-b745f1bb8e59] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:52:09.181849 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c6c876f7-d9d9-41fa-9bb2-05c79e6f76ee tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:09.182386 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c6c876f7-d9d9-41fa-9bb2-05c79e6f76ee tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:09.183198 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c6c876f7-d9d9-41fa-9bb2-05c79e6f76ee tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:09.183622 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c6c876f7-d9d9-41fa-9bb2-05c79e6f76ee tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:09.209099 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-f69696b7-073b-463f-8e23-aff3f6392d01 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:09.210862 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-f69696b7-073b-463f-8e23-aff3f6392d01 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:52:09.220852 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-f69696b7-073b-463f-8e23-aff3f6392d01 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:09.221424 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-f69696b7-073b-463f-8e23-aff3f6392d01 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:09.222265 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-f69696b7-073b-463f-8e23-aff3f6392d01 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:09.222884 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-f69696b7-073b-463f-8e23-aff3f6392d01 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:09.490063 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-c6c876f7-d9d9-41fa-9bb2-05c79e6f76ee tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68bc45984974d6da1c9151c21dae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbf5bb7e51d4d2d8594d6d1d3a797a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:52:09.492108 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-f69696b7-073b-463f-8e23-aff3f6392d01 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:52:09.499305 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-c6c876f7-d9d9-41fa-9bb2-05c79e6f76ee tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/991d0926-dfa5-43b7-a6d4-b745f1bb8e59" status: 200 len: 1366 microversion: 2.1 time: 0.334330 Apr 08 02:52:09.500095 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 336/665] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:52:09 2022] GET /compute/v2.1/servers/991d0926-dfa5-43b7-a6d4-b745f1bb8e59 => generated 1366 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:52:09.516164 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-f69696b7-073b-463f-8e23-aff3f6392d01 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:52:09.522243 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-f69696b7-073b-463f-8e23-aff3f6392d01 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:52:09.523371 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-f69696b7-073b-463f-8e23-aff3f6392d01 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1725 microversion: 2.20 time: 0.325281 Apr 08 02:52:09.524286 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 330/666] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:52:09 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1725 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 02:52:10.001537 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-c5a9d40e-81ab-4ed5-9113-0dfec0c4998d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:10.001959 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-c5a9d40e-81ab-4ed5-9113-0dfec0c4998d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 1b72863f-5373-4ef6-b303-1b7955cafa96] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:52:10.010069 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c5a9d40e-81ab-4ed5-9113-0dfec0c4998d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:10.010541 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c5a9d40e-81ab-4ed5-9113-0dfec0c4998d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:10.011829 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c5a9d40e-81ab-4ed5-9113-0dfec0c4998d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:10.012528 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c5a9d40e-81ab-4ed5-9113-0dfec0c4998d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:10.256254 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-c5a9d40e-81ab-4ed5-9113-0dfec0c4998d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "DELETE /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96/os-volume_attachments/ed472012-97bc-4464-95ac-915df5116649" status: 202 len: 0 microversion: 2.1 time: 0.263852 Apr 08 02:52:10.256873 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 337/667] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Apr 8 02:52:09 2022] DELETE /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96/os-volume_attachments/ed472012-97bc-4464-95ac-915df5116649 => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 02:52:10.272708 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-7558a10f-5788-4f50-ac0d-544c59f48e8e tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:10.275167 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-7558a10f-5788-4f50-ac0d-544c59f48e8e tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 1b72863f-5373-4ef6-b303-1b7955cafa96] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:52:10.284381 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-7558a10f-5788-4f50-ac0d-544c59f48e8e tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:10.284830 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-7558a10f-5788-4f50-ac0d-544c59f48e8e tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:10.286175 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-7558a10f-5788-4f50-ac0d-544c59f48e8e tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:10.286812 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-7558a10f-5788-4f50-ac0d-544c59f48e8e tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:10.368045 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-7558a10f-5788-4f50-ac0d-544c59f48e8e tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105159 Apr 08 02:52:10.369061 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 331/668] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Apr 8 02:52:10 2022] GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:52:10.523186 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-f2069aaa-45e9-4335-aa47-4c948be2126d tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:10.523793 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-f2069aaa-45e9-4335-aa47-4c948be2126d tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 991d0926-dfa5-43b7-a6d4-b745f1bb8e59] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:52:10.531304 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-f2069aaa-45e9-4335-aa47-4c948be2126d tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:10.531753 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-f2069aaa-45e9-4335-aa47-4c948be2126d tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:10.532518 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-f2069aaa-45e9-4335-aa47-4c948be2126d tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:10.532946 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-f2069aaa-45e9-4335-aa47-4c948be2126d tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:10.547488 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-7c968a6f-5226-412b-ad31-0ee7d2c40a72 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:10.548100 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-7c968a6f-5226-412b-ad31-0ee7d2c40a72 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:52:10.556327 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-7c968a6f-5226-412b-ad31-0ee7d2c40a72 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:10.556773 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-7c968a6f-5226-412b-ad31-0ee7d2c40a72 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:10.557699 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-7c968a6f-5226-412b-ad31-0ee7d2c40a72 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:10.558131 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-7c968a6f-5226-412b-ad31-0ee7d2c40a72 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:10.781488 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-7c968a6f-5226-412b-ad31-0ee7d2c40a72 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:52:10.803646 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-7c968a6f-5226-412b-ad31-0ee7d2c40a72 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:52:10.811926 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-7c968a6f-5226-412b-ad31-0ee7d2c40a72 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:52:10.813374 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-7c968a6f-5226-412b-ad31-0ee7d2c40a72 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 200 len: 1657 microversion: 2.20 time: 0.275758 Apr 08 02:52:10.825087 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 332/669] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:52:10 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 1657 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:52:10.880931 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-f2069aaa-45e9-4335-aa47-4c948be2126d tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68bc45984974d6da1c9151c21dae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbf5bb7e51d4d2d8594d6d1d3a797a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:52:10.897531 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-f2069aaa-45e9-4335-aa47-4c948be2126d tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/991d0926-dfa5-43b7-a6d4-b745f1bb8e59" status: 200 len: 1366 microversion: 2.1 time: 0.377346 Apr 08 02:52:10.911551 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 338/670] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:52:10 2022] GET /compute/v2.1/servers/991d0926-dfa5-43b7-a6d4-b745f1bb8e59 => generated 1366 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:52:11.061371 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [req-e8b22a59-8871-413a-ab26-5fab18389d93 req-58490ade-0313-4bd5-ae4f-05c48815c8ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e44bc1d2-0741-4081-9165-b0aca9008eaf", "name": "network-vif-deleted", "tag": "e1447a33-5dc8-44ca-8978-a2f1cdaaab34"}]} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:52:11.079390 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:52:11.079390 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: warnings.warn(msg) Apr 08 02:52:11.104253 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-e8b22a59-8871-413a-ab26-5fab18389d93 req-58490ade-0313-4bd5-ae4f-05c48815c8ae service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:11.104792 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-e8b22a59-8871-413a-ab26-5fab18389d93 req-58490ade-0313-4bd5-ae4f-05c48815c8ae service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:11.138310 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.compute.server_external_events [req-e8b22a59-8871-413a-ab26-5fab18389d93 req-58490ade-0313-4bd5-ae4f-05c48815c8ae service nova] Creating event network-vif-deleted:e1447a33-5dc8-44ca-8978-a2f1cdaaab34 for instance e44bc1d2-0741-4081-9165-b0aca9008eaf on hv-cinder-83705 Apr 08 02:52:11.152340 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [req-e8b22a59-8871-413a-ab26-5fab18389d93 req-58490ade-0313-4bd5-ae4f-05c48815c8ae service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100820 Apr 08 02:52:11.153514 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 333/671] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:52:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:52:11.385939 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-2b94ac59-42be-4480-9f2c-f21ba3a0b7ac tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:11.386969 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-2b94ac59-42be-4480-9f2c-f21ba3a0b7ac tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 1b72863f-5373-4ef6-b303-1b7955cafa96] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:52:11.394867 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-2b94ac59-42be-4480-9f2c-f21ba3a0b7ac tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:11.395334 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-2b94ac59-42be-4480-9f2c-f21ba3a0b7ac tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:11.396252 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-2b94ac59-42be-4480-9f2c-f21ba3a0b7ac tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:11.396811 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-2b94ac59-42be-4480-9f2c-f21ba3a0b7ac tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:11.475814 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-2b94ac59-42be-4480-9f2c-f21ba3a0b7ac tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.100154 Apr 08 02:52:11.476705 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 339/672] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Apr 8 02:52:11 2022] GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96/os-volume_attachments => generated 25 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 08 02:52:11.594551 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-10048958-700d-41c0-9ed0-0d6621e7a66f tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:11.595233 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-10048958-700d-41c0-9ed0-0d6621e7a66f tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 1b72863f-5373-4ef6-b303-1b7955cafa96] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:52:11.602830 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-10048958-700d-41c0-9ed0-0d6621e7a66f tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:11.603367 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-10048958-700d-41c0-9ed0-0d6621e7a66f tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:11.604198 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-10048958-700d-41c0-9ed0-0d6621e7a66f tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:11.604692 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-10048958-700d-41c0-9ed0-0d6621e7a66f tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:11.677270 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-10048958-700d-41c0-9ed0-0d6621e7a66f tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 1b72863f-5373-4ef6-b303-1b7955cafa96] Going to try to terminate instance {{(pid=96919) delete /opt/stack/nova/nova/compute/api.py:2559}} Apr 08 02:52:11.794310 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-10048958-700d-41c0-9ed0-0d6621e7a66f tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "DELETE /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96" status: 204 len: 0 microversion: 2.1 time: 0.210940 Apr 08 02:52:11.797889 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 334/673] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Apr 8 02:52:11 2022] DELETE /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 08 02:52:11.808708 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-6c417072-27d7-4d52-ad92-347d6461145b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:11.809311 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-6c417072-27d7-4d52-ad92-347d6461145b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 1b72863f-5373-4ef6-b303-1b7955cafa96] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:52:11.816988 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-6c417072-27d7-4d52-ad92-347d6461145b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:11.817525 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-6c417072-27d7-4d52-ad92-347d6461145b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:11.818371 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-6c417072-27d7-4d52-ad92-347d6461145b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:11.819093 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-6c417072-27d7-4d52-ad92-347d6461145b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:11.838582 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-bc027420-fa0c-4eab-8442-f60e0840aafe tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:11.839545 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-bc027420-fa0c-4eab-8442-f60e0840aafe tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:52:11.847115 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-bc027420-fa0c-4eab-8442-f60e0840aafe tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:11.847557 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-bc027420-fa0c-4eab-8442-f60e0840aafe tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:11.848352 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-bc027420-fa0c-4eab-8442-f60e0840aafe tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:11.848761 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-bc027420-fa0c-4eab-8442-f60e0840aafe tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:11.902252 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.wsgi [None req-bc027420-fa0c-4eab-8442-f60e0840aafe tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] HTTP exception thrown: Instance e44bc1d2-0741-4081-9165-b0aca9008eaf could not be found. Apr 08 02:52:11.902774 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-bc027420-fa0c-4eab-8442-f60e0840aafe tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Returning 404 to user: Instance e44bc1d2-0741-4081-9165-b0aca9008eaf could not be found. {{(pid=96919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Apr 08 02:52:11.903589 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-bc027420-fa0c-4eab-8442-f60e0840aafe tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 404 len: 111 microversion: 2.20 time: 0.075463 Apr 08 02:52:11.904396 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 335/674] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:52:11 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Apr 08 02:52:11.917335 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-2de65c02-c4fb-44c2-8a40-15e54997cd3b tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '.version_select at 0x7f7d4e2ec940>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:11.941711 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-2de65c02-c4fb-44c2-8a40-15e54997cd3b tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-955893127" status: 204 len: 0 microversion: 2.20 time: 0.033145 Apr 08 02:52:11.945525 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 336/675] 10.222.0.48 () {60 vars in 1258 bytes} [Fri Apr 8 02:52:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-955893127 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Apr 08 02:52:11.954172 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-735fb2e8-5386-4b5a-828f-9f8df2bba78e tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:11.954824 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-735fb2e8-5386-4b5a-828f-9f8df2bba78e tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 991d0926-dfa5-43b7-a6d4-b745f1bb8e59] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:52:11.965850 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-735fb2e8-5386-4b5a-828f-9f8df2bba78e tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:11.966299 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-735fb2e8-5386-4b5a-828f-9f8df2bba78e tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:11.967238 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-735fb2e8-5386-4b5a-828f-9f8df2bba78e tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:11.967669 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-735fb2e8-5386-4b5a-828f-9f8df2bba78e tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:12.069427 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-6c417072-27d7-4d52-ad92-347d6461145b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:52:12.087739 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-6c417072-27d7-4d52-ad92-347d6461145b tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96" status: 200 len: 1686 microversion: 2.1 time: 0.288481 Apr 08 02:52:12.089274 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 340/676] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:52:11 2022] GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96 => generated 1686 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:52:12.204302 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-735fb2e8-5386-4b5a-828f-9f8df2bba78e tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68bc45984974d6da1c9151c21dae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbf5bb7e51d4d2d8594d6d1d3a797a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:52:12.212525 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-735fb2e8-5386-4b5a-828f-9f8df2bba78e tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/991d0926-dfa5-43b7-a6d4-b745f1bb8e59" status: 200 len: 1366 microversion: 2.1 time: 0.268853 Apr 08 02:52:12.213277 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 337/677] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:52:11 2022] GET /compute/v2.1/servers/991d0926-dfa5-43b7-a6d4-b745f1bb8e59 => generated 1366 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:52:13.110679 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-c5475156-5c88-4779-b9dd-0490c768c040 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:13.111281 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-c5475156-5c88-4779-b9dd-0490c768c040 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 1b72863f-5373-4ef6-b303-1b7955cafa96] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:52:13.118524 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c5475156-5c88-4779-b9dd-0490c768c040 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:13.118984 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c5475156-5c88-4779-b9dd-0490c768c040 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:13.119736 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c5475156-5c88-4779-b9dd-0490c768c040 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:13.120158 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c5475156-5c88-4779-b9dd-0490c768c040 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:13.234563 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-4c6ca607-d166-4faa-a886-77697b936fba tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:13.235276 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-4c6ca607-d166-4faa-a886-77697b936fba tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 991d0926-dfa5-43b7-a6d4-b745f1bb8e59] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:52:13.242597 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-4c6ca607-d166-4faa-a886-77697b936fba tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:13.243072 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-4c6ca607-d166-4faa-a886-77697b936fba tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:13.243847 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-4c6ca607-d166-4faa-a886-77697b936fba tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:13.244274 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-4c6ca607-d166-4faa-a886-77697b936fba tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:13.332633 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-c5475156-5c88-4779-b9dd-0490c768c040 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:52:13.341154 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-c5475156-5c88-4779-b9dd-0490c768c040 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96" status: 200 len: 1686 microversion: 2.1 time: 0.240122 Apr 08 02:52:13.341773 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 341/678] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:52:13 2022] GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96 => generated 1686 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:52:13.451177 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-4c6ca607-d166-4faa-a886-77697b936fba tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68bc45984974d6da1c9151c21dae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbf5bb7e51d4d2d8594d6d1d3a797a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:52:13.459240 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-4c6ca607-d166-4faa-a886-77697b936fba tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/991d0926-dfa5-43b7-a6d4-b745f1bb8e59" status: 200 len: 1366 microversion: 2.1 time: 0.234110 Apr 08 02:52:13.459840 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 338/679] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:52:13 2022] GET /compute/v2.1/servers/991d0926-dfa5-43b7-a6d4-b745f1bb8e59 => generated 1366 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:52:13.950367 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-7907b0dc-539c-4afd-91da-30c1522600e4 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Action: 'create', calling method: .version_select at 0x7f7d4e46b1f0>, body: {"keypair": {"name": "tempest-keypair-1443659673"}} {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:52:13.980945 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.quota [None req-7907b0dc-539c-4afd-91da-30c1522600e4 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Getting quotas for project f673f0f0edd74c56a204930e93f143da. Resources: {'key_pairs'} {{(pid=96920) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:52:13.984925 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.quota [None req-7907b0dc-539c-4afd-91da-30c1522600e4 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Getting quotas for user f7cf97b0aa15496393f1a39d5ef759de and project f673f0f0edd74c56a204930e93f143da. Resources: {'key_pairs'} {{(pid=96920) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:52:14.231189 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.quota [None req-7907b0dc-539c-4afd-91da-30c1522600e4 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Getting quotas for project f673f0f0edd74c56a204930e93f143da. Resources: {'key_pairs'} {{(pid=96920) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:52:14.234896 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.quota [None req-7907b0dc-539c-4afd-91da-30c1522600e4 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Getting quotas for user f7cf97b0aa15496393f1a39d5ef759de and project f673f0f0edd74c56a204930e93f143da. Resources: {'key_pairs'} {{(pid=96920) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:52:14.247655 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-7907b0dc-539c-4afd-91da-30c1522600e4 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.306634 Apr 08 02:52:14.248249 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 342/680] 10.222.0.48 () {62 vars in 1198 bytes} [Fri Apr 8 02:52:13 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 308 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Apr 08 02:52:14.363267 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-50177891-5ec6-42a0-aceb-c14b9ff99ccd tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:14.363874 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-50177891-5ec6-42a0-aceb-c14b9ff99ccd tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 1b72863f-5373-4ef6-b303-1b7955cafa96] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:52:14.373434 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-50177891-5ec6-42a0-aceb-c14b9ff99ccd tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:14.373879 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-50177891-5ec6-42a0-aceb-c14b9ff99ccd tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:14.375124 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-50177891-5ec6-42a0-aceb-c14b9ff99ccd tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:14.375558 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-50177891-5ec6-42a0-aceb-c14b9ff99ccd tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:14.482079 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-220047e3-e5d4-4e99-b2d1-b9eac3cabfc2 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:14.482974 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-220047e3-e5d4-4e99-b2d1-b9eac3cabfc2 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 991d0926-dfa5-43b7-a6d4-b745f1bb8e59] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:52:14.490645 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-220047e3-e5d4-4e99-b2d1-b9eac3cabfc2 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:14.491364 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-220047e3-e5d4-4e99-b2d1-b9eac3cabfc2 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:14.492205 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-220047e3-e5d4-4e99-b2d1-b9eac3cabfc2 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:14.492719 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-220047e3-e5d4-4e99-b2d1-b9eac3cabfc2 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:14.619143 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-50177891-5ec6-42a0-aceb-c14b9ff99ccd tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:52:14.628612 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-50177891-5ec6-42a0-aceb-c14b9ff99ccd tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96" status: 200 len: 1686 microversion: 2.1 time: 0.274176 Apr 08 02:52:14.629723 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 339/681] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:52:14 2022] GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96 => generated 1686 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:52:14.916403 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-220047e3-e5d4-4e99-b2d1-b9eac3cabfc2 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68bc45984974d6da1c9151c21dae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbf5bb7e51d4d2d8594d6d1d3a797a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:52:14.924549 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-220047e3-e5d4-4e99-b2d1-b9eac3cabfc2 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/991d0926-dfa5-43b7-a6d4-b745f1bb8e59" status: 200 len: 1366 microversion: 2.1 time: 0.452476 Apr 08 02:52:14.925298 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 343/682] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:52:14 2022] GET /compute/v2.1/servers/991d0926-dfa5-43b7-a6d4-b745f1bb8e59 => generated 1366 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:52:15.653845 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-8b3dd913-434d-4941-b058-33beb5dea33e tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:15.654506 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-8b3dd913-434d-4941-b058-33beb5dea33e tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 1b72863f-5373-4ef6-b303-1b7955cafa96] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:52:15.662481 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-8b3dd913-434d-4941-b058-33beb5dea33e tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:15.663018 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-8b3dd913-434d-4941-b058-33beb5dea33e tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:15.663850 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-8b3dd913-434d-4941-b058-33beb5dea33e tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:15.664915 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-8b3dd913-434d-4941-b058-33beb5dea33e tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:15.868731 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-8b3dd913-434d-4941-b058-33beb5dea33e tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:52:15.876755 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-8b3dd913-434d-4941-b058-33beb5dea33e tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96" status: 200 len: 1686 microversion: 2.1 time: 0.234235 Apr 08 02:52:15.877284 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 340/683] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:52:15 2022] GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96 => generated 1686 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:52:15.946412 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-965e4c80-fbbd-4fa3-986d-1b51dfc510c8 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:15.947047 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-965e4c80-fbbd-4fa3-986d-1b51dfc510c8 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 991d0926-dfa5-43b7-a6d4-b745f1bb8e59] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:52:15.954359 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-965e4c80-fbbd-4fa3-986d-1b51dfc510c8 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:15.955076 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-965e4c80-fbbd-4fa3-986d-1b51dfc510c8 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:15.955837 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-965e4c80-fbbd-4fa3-986d-1b51dfc510c8 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:15.956264 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-965e4c80-fbbd-4fa3-986d-1b51dfc510c8 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:16.169536 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-965e4c80-fbbd-4fa3-986d-1b51dfc510c8 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68bc45984974d6da1c9151c21dae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbf5bb7e51d4d2d8594d6d1d3a797a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:52:16.181599 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-965e4c80-fbbd-4fa3-986d-1b51dfc510c8 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/991d0926-dfa5-43b7-a6d4-b745f1bb8e59" status: 200 len: 1366 microversion: 2.1 time: 0.243538 Apr 08 02:52:16.182402 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 344/684] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:52:15 2022] GET /compute/v2.1/servers/991d0926-dfa5-43b7-a6d4-b745f1bb8e59 => generated 1366 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:52:16.245243 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [req-d4311a13-393a-465f-8b67-d1ac03d037fa req-1c1c130a-c5d8-40ce-a70b-89711050430d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "991d0926-dfa5-43b7-a6d4-b745f1bb8e59", "name": "network-vif-plugged", "status": "completed", "tag": "91c08498-dc67-4de7-be78-2f9d88554354"}]} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:52:16.251600 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:52:16.251600 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: warnings.warn(msg) Apr 08 02:52:16.259859 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-d4311a13-393a-465f-8b67-d1ac03d037fa req-1c1c130a-c5d8-40ce-a70b-89711050430d service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:16.260303 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-d4311a13-393a-465f-8b67-d1ac03d037fa req-1c1c130a-c5d8-40ce-a70b-89711050430d service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:16.276783 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.compute.server_external_events [req-d4311a13-393a-465f-8b67-d1ac03d037fa req-1c1c130a-c5d8-40ce-a70b-89711050430d service nova] Creating event network-vif-plugged:91c08498-dc67-4de7-be78-2f9d88554354 for instance 991d0926-dfa5-43b7-a6d4-b745f1bb8e59 on hv-cinder-83705 Apr 08 02:52:16.281495 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [req-d4311a13-393a-465f-8b67-d1ac03d037fa req-1c1c130a-c5d8-40ce-a70b-89711050430d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046148 Apr 08 02:52:16.282270 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 341/685] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:52:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:52:16.899988 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-ad9c3553-3da5-4351-a808-576e94223cc0 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:16.900597 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-ad9c3553-3da5-4351-a808-576e94223cc0 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 1b72863f-5373-4ef6-b303-1b7955cafa96] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:52:16.908730 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-ad9c3553-3da5-4351-a808-576e94223cc0 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:16.909168 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-ad9c3553-3da5-4351-a808-576e94223cc0 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:16.910169 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-ad9c3553-3da5-4351-a808-576e94223cc0 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:16.910817 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-ad9c3553-3da5-4351-a808-576e94223cc0 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:17.041280 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-ad9c3553-3da5-4351-a808-576e94223cc0 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:52:17.052450 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-ad9c3553-3da5-4351-a808-576e94223cc0 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96" status: 200 len: 1619 microversion: 2.1 time: 0.162525 Apr 08 02:52:17.063412 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 345/686] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:52:16 2022] GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96 => generated 1619 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:52:17.084853 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-4844d3a6-1c47-406e-9bef-a28da8f96871 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-466154682", "imageRef": "7f8ca061-f382-4052-8d05-69f37e107684", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9177d28f-82e1-4f7a-9248-434f10dfbba9"}], "security_groups": [{"name": "tempest-securitygroup--1508792905"}], "key_name": "tempest-keypair-1443659673", "user_data": "}} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:52:17.214120 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-77ba717b-d351-406f-a2bf-55c0c3fd6627 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:17.215263 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-77ba717b-d351-406f-a2bf-55c0c3fd6627 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 991d0926-dfa5-43b7-a6d4-b745f1bb8e59] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:52:17.223673 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.network.neutron [None req-4844d3a6-1c47-406e-9bef-a28da8f96871 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] validate_networks() for [('9177d28f-82e1-4f7a-9248-434f10dfbba9', None, None, None)] {{(pid=96919) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} Apr 08 02:52:17.226976 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-77ba717b-d351-406f-a2bf-55c0c3fd6627 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:17.227643 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-77ba717b-d351-406f-a2bf-55c0c3fd6627 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:17.228593 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-77ba717b-d351-406f-a2bf-55c0c3fd6627 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:17.229318 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-77ba717b-d351-406f-a2bf-55c0c3fd6627 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:17.602752 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-77ba717b-d351-406f-a2bf-55c0c3fd6627 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68bc45984974d6da1c9151c21dae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbf5bb7e51d4d2d8594d6d1d3a797a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:52:17.611822 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-77ba717b-d351-406f-a2bf-55c0c3fd6627 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/991d0926-dfa5-43b7-a6d4-b745f1bb8e59" status: 200 len: 1366 microversion: 2.1 time: 0.416842 Apr 08 02:52:17.612704 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 346/687] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:52:17 2022] GET /compute/v2.1/servers/991d0926-dfa5-43b7-a6d4-b745f1bb8e59 => generated 1366 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:52:17.641402 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [req-8ec17468-317e-4129-869d-149ff32578d3 req-d169b117-b8df-4b5c-abec-c12a277467d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b72863f-5373-4ef6-b303-1b7955cafa96", "name": "network-vif-deleted", "tag": "925ad71f-f0c4-4cad-b48b-9505cac52cd3"}]} {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:52:17.647972 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:52:17.647972 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: warnings.warn(msg) Apr 08 02:52:17.657506 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-8ec17468-317e-4129-869d-149ff32578d3 req-d169b117-b8df-4b5c-abec-c12a277467d2 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:17.658148 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-8ec17468-317e-4129-869d-149ff32578d3 req-d169b117-b8df-4b5c-abec-c12a277467d2 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:17.678753 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.compute.server_external_events [req-8ec17468-317e-4129-869d-149ff32578d3 req-d169b117-b8df-4b5c-abec-c12a277467d2 service nova] Creating event network-vif-deleted:925ad71f-f0c4-4cad-b48b-9505cac52cd3 for instance 1b72863f-5373-4ef6-b303-1b7955cafa96 on hv-cinder-83705 Apr 08 02:52:17.685761 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [req-8ec17468-317e-4129-869d-149ff32578d3 req-d169b117-b8df-4b5c-abec-c12a277467d2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071409 Apr 08 02:52:17.686612 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 347/688] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:52:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:52:17.974455 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.virt.hardware [None req-4844d3a6-1c47-406e-9bef-a28da8f96871 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Flavor limits 0:0:0 {{(pid=96919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} Apr 08 02:52:17.974926 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.virt.hardware [None req-4844d3a6-1c47-406e-9bef-a28da8f96871 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Image limits 0:0:0 {{(pid=96919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} Apr 08 02:52:17.975406 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.virt.hardware [None req-4844d3a6-1c47-406e-9bef-a28da8f96871 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Flavor pref 0:0:0 {{(pid=96919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} Apr 08 02:52:17.975814 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.virt.hardware [None req-4844d3a6-1c47-406e-9bef-a28da8f96871 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Image pref 0:0:0 {{(pid=96919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} Apr 08 02:52:17.976223 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.virt.hardware [None req-4844d3a6-1c47-406e-9bef-a28da8f96871 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=96919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} Apr 08 02:52:17.985571 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-4844d3a6-1c47-406e-9bef-a28da8f96871 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:17.986015 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-4844d3a6-1c47-406e-9bef-a28da8f96871 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:17.986888 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-4844d3a6-1c47-406e-9bef-a28da8f96871 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:17.987322 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-4844d3a6-1c47-406e-9bef-a28da8f96871 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:18.004655 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.quota [None req-4844d3a6-1c47-406e-9bef-a28da8f96871 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Getting quotas for project f673f0f0edd74c56a204930e93f143da. Resources: {'instances', 'cores', 'ram'} {{(pid=96919) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:52:18.009115 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.quota [None req-4844d3a6-1c47-406e-9bef-a28da8f96871 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Getting quotas for user f7cf97b0aa15496393f1a39d5ef759de and project f673f0f0edd74c56a204930e93f143da. Resources: {'instances', 'cores', 'ram'} {{(pid=96919) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:52:18.019888 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-4844d3a6-1c47-406e-9bef-a28da8f96871 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Going to run 1 instances... {{(pid=96919) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} Apr 08 02:52:18.022300 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-4844d3a6-1c47-406e-9bef-a28da8f96871 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: bbeb7a47-a8ee-44b3-bc79-bd12670aaa33] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7f8ca061-f382-4052-8d05-69f37e107684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=96919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} Apr 08 02:52:18.076789 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-b2d334fb-2f98-4d7a-8d65-84573e709692 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:18.078238 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-b2d334fb-2f98-4d7a-8d65-84573e709692 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 1b72863f-5373-4ef6-b303-1b7955cafa96] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:52:18.085115 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-4844d3a6-1c47-406e-9bef-a28da8f96871 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.010668 Apr 08 02:52:18.087186 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 342/689] 10.222.0.48 () {62 vars in 1187 bytes} [Fri Apr 8 02:52:17 2022] POST /compute/v2.1/servers => generated 402 bytes in 1014 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 08 02:52:18.093589 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b2d334fb-2f98-4d7a-8d65-84573e709692 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:18.094025 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b2d334fb-2f98-4d7a-8d65-84573e709692 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:18.094842 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b2d334fb-2f98-4d7a-8d65-84573e709692 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:18.095282 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b2d334fb-2f98-4d7a-8d65-84573e709692 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:18.104358 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-63123e8f-d77a-4448-87f6-12f2ab1118e3 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:18.105499 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-63123e8f-d77a-4448-87f6-12f2ab1118e3 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: bbeb7a47-a8ee-44b3-bc79-bd12670aaa33] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:52:18.207926 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-63123e8f-d77a-4448-87f6-12f2ab1118e3 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:52:18.221895 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b2d334fb-2f98-4d7a-8d65-84573e709692 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:18.222346 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b2d334fb-2f98-4d7a-8d65-84573e709692 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:18.222822 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.objects.instance [None req-b2d334fb-2f98-4d7a-8d65-84573e709692 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lazy-loading 'fault' on Instance uuid 1b72863f-5373-4ef6-b303-1b7955cafa96 {{(pid=96920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 08 02:52:18.233440 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-63123e8f-d77a-4448-87f6-12f2ab1118e3 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:52:18.246609 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-63123e8f-d77a-4448-87f6-12f2ab1118e3 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:52:18.248714 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-63123e8f-d77a-4448-87f6-12f2ab1118e3 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33" status: 200 len: 1281 microversion: 2.20 time: 0.155794 Apr 08 02:52:18.255073 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 343/690] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:52:18 2022] GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33 => generated 1281 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:52:18.306458 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-b2d334fb-2f98-4d7a-8d65-84573e709692 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:52:18.314655 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-b2d334fb-2f98-4d7a-8d65-84573e709692 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96" status: 200 len: 1334 microversion: 2.1 time: 0.248179 Apr 08 02:52:18.325680 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 348/691] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:52:18 2022] GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96 => generated 1334 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:52:18.635590 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-bfacf9a8-df9e-461e-a48b-804dcf4366a5 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:18.636246 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-bfacf9a8-df9e-461e-a48b-804dcf4366a5 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 991d0926-dfa5-43b7-a6d4-b745f1bb8e59] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:52:18.644356 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-bfacf9a8-df9e-461e-a48b-804dcf4366a5 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:18.644785 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-bfacf9a8-df9e-461e-a48b-804dcf4366a5 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:18.645746 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-bfacf9a8-df9e-461e-a48b-804dcf4366a5 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:18.647150 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-bfacf9a8-df9e-461e-a48b-804dcf4366a5 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:18.953683 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-bfacf9a8-df9e-461e-a48b-804dcf4366a5 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68bc45984974d6da1c9151c21dae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbf5bb7e51d4d2d8594d6d1d3a797a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:52:18.963110 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-bfacf9a8-df9e-461e-a48b-804dcf4366a5 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/991d0926-dfa5-43b7-a6d4-b745f1bb8e59" status: 200 len: 1555 microversion: 2.1 time: 0.337562 Apr 08 02:52:18.963848 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 344/692] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:52:18 2022] GET /compute/v2.1/servers/991d0926-dfa5-43b7-a6d4-b745f1bb8e59 => generated 1555 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:52:18.985110 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-b8afd221-d1fd-47ed-85c3-3aa7879c7a80 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:18.985600 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-b8afd221-d1fd-47ed-85c3-3aa7879c7a80 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 991d0926-dfa5-43b7-a6d4-b745f1bb8e59] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:52:18.994484 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b8afd221-d1fd-47ed-85c3-3aa7879c7a80 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:18.994989 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b8afd221-d1fd-47ed-85c3-3aa7879c7a80 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:18.995768 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b8afd221-d1fd-47ed-85c3-3aa7879c7a80 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:18.996204 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b8afd221-d1fd-47ed-85c3-3aa7879c7a80 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:19.147056 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-b8afd221-d1fd-47ed-85c3-3aa7879c7a80 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/991d0926-dfa5-43b7-a6d4-b745f1bb8e59/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.171781 Apr 08 02:52:19.147779 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 349/693] 10.222.0.48 () {58 vars in 1274 bytes} [Fri Apr 8 02:52:18 2022] GET /compute/v2.1/servers/991d0926-dfa5-43b7-a6d4-b745f1bb8e59/os-interface => generated 284 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:52:19.272954 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-ce8b92b3-1d7b-4d6a-afe2-424c4a87b3bc tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:19.275125 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-ce8b92b3-1d7b-4d6a-afe2-424c4a87b3bc tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: bbeb7a47-a8ee-44b3-bc79-bd12670aaa33] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:52:19.284059 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ce8b92b3-1d7b-4d6a-afe2-424c4a87b3bc tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:19.284803 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ce8b92b3-1d7b-4d6a-afe2-424c4a87b3bc tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:19.285801 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ce8b92b3-1d7b-4d6a-afe2-424c4a87b3bc tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:19.286466 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ce8b92b3-1d7b-4d6a-afe2-424c4a87b3bc tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:19.339735 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-4a97b268-0a41-4bf3-8891-ba86f6daa0af tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:19.340346 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-4a97b268-0a41-4bf3-8891-ba86f6daa0af tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 1b72863f-5373-4ef6-b303-1b7955cafa96] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:52:19.362790 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-4a97b268-0a41-4bf3-8891-ba86f6daa0af tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:19.363975 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-4a97b268-0a41-4bf3-8891-ba86f6daa0af tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:19.364975 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-4a97b268-0a41-4bf3-8891-ba86f6daa0af tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:19.365518 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-4a97b268-0a41-4bf3-8891-ba86f6daa0af tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:19.428026 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-ce8b92b3-1d7b-4d6a-afe2-424c4a87b3bc tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:52:19.432484 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.wsgi [None req-4a97b268-0a41-4bf3-8891-ba86f6daa0af tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] HTTP exception thrown: Instance 1b72863f-5373-4ef6-b303-1b7955cafa96 could not be found. Apr 08 02:52:19.432835 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-4a97b268-0a41-4bf3-8891-ba86f6daa0af tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Returning 404 to user: Instance 1b72863f-5373-4ef6-b303-1b7955cafa96 could not be found. {{(pid=96920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Apr 08 02:52:19.433647 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-4a97b268-0a41-4bf3-8891-ba86f6daa0af tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96" status: 404 len: 111 microversion: 2.1 time: 0.105231 Apr 08 02:52:19.434399 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 350/694] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:52:19 2022] GET /compute/v2.1/servers/1b72863f-5373-4ef6-b303-1b7955cafa96 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 08 02:52:19.447131 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-50f2962b-e544-4ac8-b917-d5dbecf01e60 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '.version_select at 0x7f7d4e5c4940>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:19.448159 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-ce8b92b3-1d7b-4d6a-afe2-424c4a87b3bc tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:52:19.454370 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-ce8b92b3-1d7b-4d6a-afe2-424c4a87b3bc tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:52:19.455468 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-ce8b92b3-1d7b-4d6a-afe2-424c4a87b3bc tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33" status: 200 len: 1341 microversion: 2.20 time: 0.191672 Apr 08 02:52:19.456525 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 345/695] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:52:19 2022] GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33 => generated 1341 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:52:19.481474 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-50f2962b-e544-4ac8-b917-d5dbecf01e60 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-361812968" status: 202 len: 0 microversion: 2.1 time: 0.042965 Apr 08 02:52:19.482377 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 351/696] 10.222.0.48 () {58 vars in 1217 bytes} [Fri Apr 8 02:52:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-361812968 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 08 02:52:20.479506 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-c397e469-c1cb-40f2-a90b-6b7568e6e4ef tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:20.480113 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-c397e469-c1cb-40f2-a90b-6b7568e6e4ef tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: bbeb7a47-a8ee-44b3-bc79-bd12670aaa33] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:52:20.487306 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-c397e469-c1cb-40f2-a90b-6b7568e6e4ef tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:20.487675 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-c397e469-c1cb-40f2-a90b-6b7568e6e4ef tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:20.488439 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-c397e469-c1cb-40f2-a90b-6b7568e6e4ef tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:20.488866 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-c397e469-c1cb-40f2-a90b-6b7568e6e4ef tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:20.627469 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-c397e469-c1cb-40f2-a90b-6b7568e6e4ef tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:52:20.643583 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-c397e469-c1cb-40f2-a90b-6b7568e6e4ef tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:52:20.650166 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-c397e469-c1cb-40f2-a90b-6b7568e6e4ef tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:52:20.651312 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-c397e469-c1cb-40f2-a90b-6b7568e6e4ef tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33" status: 200 len: 1339 microversion: 2.20 time: 0.181872 Apr 08 02:52:20.651841 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 346/697] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:52:20 2022] GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33 => generated 1339 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:52:21.675876 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-5b9223e5-e28b-474e-b9e6-96502a3101e4 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:21.676572 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-5b9223e5-e28b-474e-b9e6-96502a3101e4 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: bbeb7a47-a8ee-44b3-bc79-bd12670aaa33] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:52:21.684402 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-5b9223e5-e28b-474e-b9e6-96502a3101e4 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:21.684838 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-5b9223e5-e28b-474e-b9e6-96502a3101e4 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:21.685605 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-5b9223e5-e28b-474e-b9e6-96502a3101e4 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:21.686032 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-5b9223e5-e28b-474e-b9e6-96502a3101e4 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:21.912517 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-5b9223e5-e28b-474e-b9e6-96502a3101e4 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:52:21.926235 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-5b9223e5-e28b-474e-b9e6-96502a3101e4 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:52:21.933124 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-5b9223e5-e28b-474e-b9e6-96502a3101e4 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:52:21.934246 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-5b9223e5-e28b-474e-b9e6-96502a3101e4 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33" status: 200 len: 1407 microversion: 2.20 time: 0.268129 Apr 08 02:52:21.934877 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 352/698] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:52:21 2022] GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33 => generated 1407 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:52:22.344309 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [req-eb2e5001-ca48-4601-b652-792ac4a98f13 req-fc7c68df-4cb0-4f02-9246-edc1d36cdcfa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "991d0926-dfa5-43b7-a6d4-b745f1bb8e59", "tag": "91c08498-dc67-4de7-be78-2f9d88554354"}]} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:52:22.350507 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:52:22.350507 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: warnings.warn(msg) Apr 08 02:52:22.358806 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-eb2e5001-ca48-4601-b652-792ac4a98f13 req-fc7c68df-4cb0-4f02-9246-edc1d36cdcfa service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:22.359249 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-eb2e5001-ca48-4601-b652-792ac4a98f13 req-fc7c68df-4cb0-4f02-9246-edc1d36cdcfa service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:22.376641 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.compute.server_external_events [req-eb2e5001-ca48-4601-b652-792ac4a98f13 req-fc7c68df-4cb0-4f02-9246-edc1d36cdcfa service nova] Creating event network-changed:91c08498-dc67-4de7-be78-2f9d88554354 for instance 991d0926-dfa5-43b7-a6d4-b745f1bb8e59 on hv-cinder-83705 Apr 08 02:52:22.381933 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [req-eb2e5001-ca48-4601-b652-792ac4a98f13 req-fc7c68df-4cb0-4f02-9246-edc1d36cdcfa service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048368 Apr 08 02:52:22.384933 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 347/699] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:52:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:52:22.963296 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-9ab86689-8635-44c8-ac10-13a928ba6402 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:22.964818 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-9ab86689-8635-44c8-ac10-13a928ba6402 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: bbeb7a47-a8ee-44b3-bc79-bd12670aaa33] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:52:22.984122 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-c63a1091-249e-4d30-9dc5-02f856ee5ea0 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:22.985357 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-c63a1091-249e-4d30-9dc5-02f856ee5ea0 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 6228b11f-244d-4e25-8b1f-e19a90cc8c20] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:52:22.998523 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-9ab86689-8635-44c8-ac10-13a928ba6402 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:23.000563 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-9ab86689-8635-44c8-ac10-13a928ba6402 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:23.001257 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-c63a1091-249e-4d30-9dc5-02f856ee5ea0 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:23.002934 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-9ab86689-8635-44c8-ac10-13a928ba6402 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:23.003802 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-c63a1091-249e-4d30-9dc5-02f856ee5ea0 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:23.005534 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-9ab86689-8635-44c8-ac10-13a928ba6402 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:23.006305 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-c63a1091-249e-4d30-9dc5-02f856ee5ea0 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:23.006997 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-c63a1091-249e-4d30-9dc5-02f856ee5ea0 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:23.095602 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-c63a1091-249e-4d30-9dc5-02f856ee5ea0 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 6228b11f-244d-4e25-8b1f-e19a90cc8c20] Going to try to terminate instance {{(pid=96919) delete /opt/stack/nova/nova/compute/api.py:2559}} Apr 08 02:52:23.231754 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-c63a1091-249e-4d30-9dc5-02f856ee5ea0 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "DELETE /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20" status: 204 len: 0 microversion: 2.1 time: 0.264325 Apr 08 02:52:23.232381 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 348/700] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Apr 8 02:52:22 2022] DELETE /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 08 02:52:23.246166 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-456f3c65-46c7-4d6e-866d-a6e39a2319fb tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:23.246820 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-456f3c65-46c7-4d6e-866d-a6e39a2319fb tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 6228b11f-244d-4e25-8b1f-e19a90cc8c20] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:52:23.253858 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-456f3c65-46c7-4d6e-866d-a6e39a2319fb tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:23.254303 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-456f3c65-46c7-4d6e-866d-a6e39a2319fb tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:23.255123 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-456f3c65-46c7-4d6e-866d-a6e39a2319fb tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:23.255596 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-456f3c65-46c7-4d6e-866d-a6e39a2319fb tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:23.285297 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-9ab86689-8635-44c8-ac10-13a928ba6402 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:52:23.299747 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-9ab86689-8635-44c8-ac10-13a928ba6402 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:52:23.306556 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-9ab86689-8635-44c8-ac10-13a928ba6402 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:52:23.309244 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-9ab86689-8635-44c8-ac10-13a928ba6402 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33" status: 200 len: 1407 microversion: 2.20 time: 0.358733 Apr 08 02:52:23.319920 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 353/701] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:52:22 2022] GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33 => generated 1407 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:52:23.533089 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-456f3c65-46c7-4d6e-866d-a6e39a2319fb tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:52:23.541660 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-456f3c65-46c7-4d6e-866d-a6e39a2319fb tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20" status: 200 len: 1507 microversion: 2.1 time: 0.305168 Apr 08 02:52:23.542198 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 349/702] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:52:23 2022] GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20 => generated 1507 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:52:24.335089 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-c8d54ffc-35e3-490e-b900-d7ef5b204226 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:24.336185 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-c8d54ffc-35e3-490e-b900-d7ef5b204226 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: bbeb7a47-a8ee-44b3-bc79-bd12670aaa33] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:52:24.345611 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c8d54ffc-35e3-490e-b900-d7ef5b204226 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:24.346052 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c8d54ffc-35e3-490e-b900-d7ef5b204226 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:24.346874 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c8d54ffc-35e3-490e-b900-d7ef5b204226 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:24.347302 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c8d54ffc-35e3-490e-b900-d7ef5b204226 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:24.421898 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [req-089d710e-9d72-4360-9302-e57d32e2420d req-1547ffd9-9345-471d-89bc-cf279bddff3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbeb7a47-a8ee-44b3-bc79-bd12670aaa33", "tag": "2bd62dce-ca58-4c9e-bb8a-99411d102c48"}]} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:52:24.428252 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:52:24.428252 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: warnings.warn(msg) Apr 08 02:52:24.437017 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-089d710e-9d72-4360-9302-e57d32e2420d req-1547ffd9-9345-471d-89bc-cf279bddff3d service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:24.437456 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-089d710e-9d72-4360-9302-e57d32e2420d req-1547ffd9-9345-471d-89bc-cf279bddff3d service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:24.453860 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.compute.server_external_events [req-089d710e-9d72-4360-9302-e57d32e2420d req-1547ffd9-9345-471d-89bc-cf279bddff3d service nova] Creating event network-changed:2bd62dce-ca58-4c9e-bb8a-99411d102c48 for instance bbeb7a47-a8ee-44b3-bc79-bd12670aaa33 on hv-cinder-83705 Apr 08 02:52:24.458544 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [req-089d710e-9d72-4360-9302-e57d32e2420d req-1547ffd9-9345-471d-89bc-cf279bddff3d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046050 Apr 08 02:52:24.459564 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 350/703] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:52:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 02:52:24.566291 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-e66cc0b7-c525-4b9f-833a-d5fd6810a83d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:24.567012 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-e66cc0b7-c525-4b9f-833a-d5fd6810a83d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 6228b11f-244d-4e25-8b1f-e19a90cc8c20] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:52:24.582067 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-e66cc0b7-c525-4b9f-833a-d5fd6810a83d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:24.582833 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-e66cc0b7-c525-4b9f-833a-d5fd6810a83d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:24.583779 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-e66cc0b7-c525-4b9f-833a-d5fd6810a83d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:24.584402 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-e66cc0b7-c525-4b9f-833a-d5fd6810a83d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:24.634657 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-c8d54ffc-35e3-490e-b900-d7ef5b204226 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:52:24.654941 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-c8d54ffc-35e3-490e-b900-d7ef5b204226 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:52:24.661438 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-c8d54ffc-35e3-490e-b900-d7ef5b204226 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:52:24.663296 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-c8d54ffc-35e3-490e-b900-d7ef5b204226 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33" status: 200 len: 1407 microversion: 2.20 time: 0.339900 Apr 08 02:52:24.675089 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 354/704] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:52:24 2022] GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33 => generated 1407 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:52:24.752100 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-e66cc0b7-c525-4b9f-833a-d5fd6810a83d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:52:24.761134 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-e66cc0b7-c525-4b9f-833a-d5fd6810a83d tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20" status: 200 len: 1465 microversion: 2.1 time: 0.206659 Apr 08 02:52:24.761872 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 351/705] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:52:24 2022] GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20 => generated 1465 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:52:25.687640 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-86d3da65-9cf2-4545-ad73-5cfe7271acdb tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:25.688231 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-86d3da65-9cf2-4545-ad73-5cfe7271acdb tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: bbeb7a47-a8ee-44b3-bc79-bd12670aaa33] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:52:25.696244 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-86d3da65-9cf2-4545-ad73-5cfe7271acdb tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:25.696687 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-86d3da65-9cf2-4545-ad73-5cfe7271acdb tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:25.697444 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-86d3da65-9cf2-4545-ad73-5cfe7271acdb tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:25.697873 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-86d3da65-9cf2-4545-ad73-5cfe7271acdb tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:25.783957 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-38a49f9c-b2be-4ad4-b74f-bb9d8c26ec0e tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:25.784583 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-38a49f9c-b2be-4ad4-b74f-bb9d8c26ec0e tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: 6228b11f-244d-4e25-8b1f-e19a90cc8c20] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:52:25.791876 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-38a49f9c-b2be-4ad4-b74f-bb9d8c26ec0e tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:25.792313 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-38a49f9c-b2be-4ad4-b74f-bb9d8c26ec0e tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:25.793081 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-38a49f9c-b2be-4ad4-b74f-bb9d8c26ec0e tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:25.793508 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-38a49f9c-b2be-4ad4-b74f-bb9d8c26ec0e tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:25.844732 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.wsgi [None req-38a49f9c-b2be-4ad4-b74f-bb9d8c26ec0e tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] HTTP exception thrown: Instance 6228b11f-244d-4e25-8b1f-e19a90cc8c20 could not be found. Apr 08 02:52:25.845326 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-38a49f9c-b2be-4ad4-b74f-bb9d8c26ec0e tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Returning 404 to user: Instance 6228b11f-244d-4e25-8b1f-e19a90cc8c20 could not be found. {{(pid=96919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Apr 08 02:52:25.846349 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-38a49f9c-b2be-4ad4-b74f-bb9d8c26ec0e tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20" status: 404 len: 111 microversion: 2.1 time: 0.070986 Apr 08 02:52:25.846705 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 352/706] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:52:25 2022] GET /compute/v2.1/servers/6228b11f-244d-4e25-8b1f-e19a90cc8c20 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 02:52:25.859627 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-f7bfb609-2b04-4111-8c19-b8a55c8d9f3e tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:25.860112 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-f7bfb609-2b04-4111-8c19-b8a55c8d9f3e tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: fe2c4fd0-315a-4d94-8913-a661cdfa293a] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:52:25.868434 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-f7bfb609-2b04-4111-8c19-b8a55c8d9f3e tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:25.868434 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-f7bfb609-2b04-4111-8c19-b8a55c8d9f3e tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:25.869191 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-f7bfb609-2b04-4111-8c19-b8a55c8d9f3e tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:25.869619 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-f7bfb609-2b04-4111-8c19-b8a55c8d9f3e tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:25.901666 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-86d3da65-9cf2-4545-ad73-5cfe7271acdb tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:52:25.915135 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-86d3da65-9cf2-4545-ad73-5cfe7271acdb tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:52:25.922268 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-86d3da65-9cf2-4545-ad73-5cfe7271acdb tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:52:25.923366 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-86d3da65-9cf2-4545-ad73-5cfe7271acdb tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33" status: 200 len: 1407 microversion: 2.20 time: 0.245308 Apr 08 02:52:25.923893 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 355/707] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:52:25 2022] GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33 => generated 1407 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:52:25.937374 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-f7bfb609-2b04-4111-8c19-b8a55c8d9f3e tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: fe2c4fd0-315a-4d94-8913-a661cdfa293a] Going to try to terminate instance {{(pid=96919) delete /opt/stack/nova/nova/compute/api.py:2559}} Apr 08 02:52:26.049168 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-f7bfb609-2b04-4111-8c19-b8a55c8d9f3e tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "DELETE /compute/v2.1/servers/fe2c4fd0-315a-4d94-8913-a661cdfa293a" status: 204 len: 0 microversion: 2.1 time: 0.197966 Apr 08 02:52:26.049820 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 353/708] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Apr 8 02:52:25 2022] DELETE /compute/v2.1/servers/fe2c4fd0-315a-4d94-8913-a661cdfa293a => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 08 02:52:26.063300 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-379efce5-87d8-40d8-901d-ced68ecbb3cb tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:26.063897 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-379efce5-87d8-40d8-901d-ced68ecbb3cb tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: fe2c4fd0-315a-4d94-8913-a661cdfa293a] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:52:26.071077 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-379efce5-87d8-40d8-901d-ced68ecbb3cb tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:26.071522 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-379efce5-87d8-40d8-901d-ced68ecbb3cb tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:26.072277 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-379efce5-87d8-40d8-901d-ced68ecbb3cb tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:26.072706 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-379efce5-87d8-40d8-901d-ced68ecbb3cb tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:26.272329 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-379efce5-87d8-40d8-901d-ced68ecbb3cb tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:52:26.280988 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-379efce5-87d8-40d8-901d-ced68ecbb3cb tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/fe2c4fd0-315a-4d94-8913-a661cdfa293a" status: 200 len: 1520 microversion: 2.1 time: 0.227017 Apr 08 02:52:26.281517 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 356/709] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:52:26 2022] GET /compute/v2.1/servers/fe2c4fd0-315a-4d94-8913-a661cdfa293a => generated 1520 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:52:26.487386 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [req-41386fea-7edf-430c-820a-02d1b67ccf60 req-6d0fd54a-2066-4391-a224-22821e20d9b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6228b11f-244d-4e25-8b1f-e19a90cc8c20", "name": "network-vif-deleted", "tag": "8cf7f363-1f61-4342-8249-2e47822bc532"}]} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:52:26.493430 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:52:26.493430 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: warnings.warn(msg) Apr 08 02:52:26.501304 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-41386fea-7edf-430c-820a-02d1b67ccf60 req-6d0fd54a-2066-4391-a224-22821e20d9b0 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:26.501753 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-41386fea-7edf-430c-820a-02d1b67ccf60 req-6d0fd54a-2066-4391-a224-22821e20d9b0 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:26.518560 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.compute.server_external_events [req-41386fea-7edf-430c-820a-02d1b67ccf60 req-6d0fd54a-2066-4391-a224-22821e20d9b0 service nova] Creating event network-vif-deleted:8cf7f363-1f61-4342-8249-2e47822bc532 for instance 6228b11f-244d-4e25-8b1f-e19a90cc8c20 on hv-cinder-83705 Apr 08 02:52:26.522859 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [req-41386fea-7edf-430c-820a-02d1b67ccf60 req-6d0fd54a-2066-4391-a224-22821e20d9b0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044816 Apr 08 02:52:26.524065 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 354/710] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:52:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:52:26.947832 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-201268ea-d54b-402a-a3dd-86d598a25210 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:26.948436 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-201268ea-d54b-402a-a3dd-86d598a25210 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: bbeb7a47-a8ee-44b3-bc79-bd12670aaa33] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:52:26.956597 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-201268ea-d54b-402a-a3dd-86d598a25210 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:26.957107 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-201268ea-d54b-402a-a3dd-86d598a25210 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:26.957964 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-201268ea-d54b-402a-a3dd-86d598a25210 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:26.958482 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-201268ea-d54b-402a-a3dd-86d598a25210 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:27.174150 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-201268ea-d54b-402a-a3dd-86d598a25210 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:52:27.188990 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-201268ea-d54b-402a-a3dd-86d598a25210 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:52:27.195630 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-201268ea-d54b-402a-a3dd-86d598a25210 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:52:27.196561 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-201268ea-d54b-402a-a3dd-86d598a25210 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33" status: 200 len: 1407 microversion: 2.20 time: 0.258505 Apr 08 02:52:27.197087 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 357/711] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:52:26 2022] GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33 => generated 1407 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:52:27.303244 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-160ca83f-7e36-46f3-8697-e16f9ff9c163 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:27.303900 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-160ca83f-7e36-46f3-8697-e16f9ff9c163 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: fe2c4fd0-315a-4d94-8913-a661cdfa293a] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:52:27.312168 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-160ca83f-7e36-46f3-8697-e16f9ff9c163 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:27.312608 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-160ca83f-7e36-46f3-8697-e16f9ff9c163 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:27.313358 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-160ca83f-7e36-46f3-8697-e16f9ff9c163 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:27.313783 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-160ca83f-7e36-46f3-8697-e16f9ff9c163 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:27.517694 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-160ca83f-7e36-46f3-8697-e16f9ff9c163 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153666ecd9c84936bd1c9ce32373ca27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0c4cd55acc4607852747c5d796609e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:52:27.526524 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-160ca83f-7e36-46f3-8697-e16f9ff9c163 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/fe2c4fd0-315a-4d94-8913-a661cdfa293a" status: 200 len: 1520 microversion: 2.1 time: 0.232767 Apr 08 02:52:27.527096 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 355/712] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:52:27 2022] GET /compute/v2.1/servers/fe2c4fd0-315a-4d94-8913-a661cdfa293a => generated 1520 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:52:28.219572 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-84346c7f-a435-495b-9807-6233fc182ed9 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:28.220181 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-84346c7f-a435-495b-9807-6233fc182ed9 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: bbeb7a47-a8ee-44b3-bc79-bd12670aaa33] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:52:28.227482 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-84346c7f-a435-495b-9807-6233fc182ed9 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:28.227936 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-84346c7f-a435-495b-9807-6233fc182ed9 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:28.228721 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-84346c7f-a435-495b-9807-6233fc182ed9 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:28.229150 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-84346c7f-a435-495b-9807-6233fc182ed9 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:28.430020 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-84346c7f-a435-495b-9807-6233fc182ed9 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:52:28.442982 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-84346c7f-a435-495b-9807-6233fc182ed9 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:52:28.449643 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-84346c7f-a435-495b-9807-6233fc182ed9 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:52:28.450689 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-84346c7f-a435-495b-9807-6233fc182ed9 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33" status: 200 len: 1407 microversion: 2.20 time: 0.240570 Apr 08 02:52:28.451203 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 358/713] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:52:28 2022] GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33 => generated 1407 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:52:28.542080 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [req-c774fea9-72d5-4357-9d0b-60a72f095655 req-3fa8e35c-3598-482c-8638-8cf787299b1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe2c4fd0-315a-4d94-8913-a661cdfa293a", "name": "network-vif-deleted", "tag": "1765d10f-4f9f-4883-99d5-299517e80053"}]} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:52:28.548127 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:52:28.548127 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: warnings.warn(msg) Apr 08 02:52:28.549086 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-b0f25c99-187d-4558-b1c8-c78844461615 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:28.549688 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-b0f25c99-187d-4558-b1c8-c78844461615 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] [instance: fe2c4fd0-315a-4d94-8913-a661cdfa293a] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:52:28.556812 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-c774fea9-72d5-4357-9d0b-60a72f095655 req-3fa8e35c-3598-482c-8638-8cf787299b1a service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:28.557227 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-c774fea9-72d5-4357-9d0b-60a72f095655 req-3fa8e35c-3598-482c-8638-8cf787299b1a service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:28.557461 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b0f25c99-187d-4558-b1c8-c78844461615 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:28.557902 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b0f25c99-187d-4558-b1c8-c78844461615 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:28.558700 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b0f25c99-187d-4558-b1c8-c78844461615 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:28.559122 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b0f25c99-187d-4558-b1c8-c78844461615 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:28.572831 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.compute.server_external_events [req-c774fea9-72d5-4357-9d0b-60a72f095655 req-3fa8e35c-3598-482c-8638-8cf787299b1a service nova] Creating event network-vif-deleted:1765d10f-4f9f-4883-99d5-299517e80053 for instance fe2c4fd0-315a-4d94-8913-a661cdfa293a on hv-cinder-83705 Apr 08 02:52:28.577631 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [req-c774fea9-72d5-4357-9d0b-60a72f095655 req-3fa8e35c-3598-482c-8638-8cf787299b1a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045047 Apr 08 02:52:28.578200 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 356/714] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:52:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:52:28.607954 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.wsgi [None req-b0f25c99-187d-4558-b1c8-c78844461615 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] HTTP exception thrown: Instance fe2c4fd0-315a-4d94-8913-a661cdfa293a could not be found. Apr 08 02:52:28.608547 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-b0f25c99-187d-4558-b1c8-c78844461615 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] Returning 404 to user: Instance fe2c4fd0-315a-4d94-8913-a661cdfa293a could not be found. {{(pid=96920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Apr 08 02:52:28.609354 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-b0f25c99-187d-4558-b1c8-c78844461615 tempest-ServerRescueNegativeTestJSON-1646744704 tempest-ServerRescueNegativeTestJSON-1646744704-project] 10.222.0.48 "GET /compute/v2.1/servers/fe2c4fd0-315a-4d94-8913-a661cdfa293a" status: 404 len: 111 microversion: 2.1 time: 0.069134 Apr 08 02:52:28.609887 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 359/715] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:52:28 2022] GET /compute/v2.1/servers/fe2c4fd0-315a-4d94-8913-a661cdfa293a => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 08 02:52:29.474883 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-3f653851-a4eb-47f4-9800-1bfb1617d66d tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:29.475567 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-3f653851-a4eb-47f4-9800-1bfb1617d66d tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: bbeb7a47-a8ee-44b3-bc79-bd12670aaa33] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:52:29.483584 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-3f653851-a4eb-47f4-9800-1bfb1617d66d tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:29.484016 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-3f653851-a4eb-47f4-9800-1bfb1617d66d tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:29.484775 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-3f653851-a4eb-47f4-9800-1bfb1617d66d tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:29.485194 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-3f653851-a4eb-47f4-9800-1bfb1617d66d tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:29.817339 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-3f653851-a4eb-47f4-9800-1bfb1617d66d tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:52:29.830845 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-3f653851-a4eb-47f4-9800-1bfb1617d66d tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:52:29.837355 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-3f653851-a4eb-47f4-9800-1bfb1617d66d tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:52:29.838406 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-3f653851-a4eb-47f4-9800-1bfb1617d66d tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33" status: 200 len: 1407 microversion: 2.20 time: 0.373104 Apr 08 02:52:29.838956 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 357/716] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:52:29 2022] GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33 => generated 1407 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:52:30.298031 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [req-a1f7c530-c855-4522-8ba0-c5e4aabf6370 req-259bf691-2289-4cbe-b256-27b39803c6f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbeb7a47-a8ee-44b3-bc79-bd12670aaa33", "name": "network-vif-plugged", "status": "completed", "tag": "2bd62dce-ca58-4c9e-bb8a-99411d102c48"}]} {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:52:30.304542 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:52:30.304542 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: warnings.warn(msg) Apr 08 02:52:30.312768 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-a1f7c530-c855-4522-8ba0-c5e4aabf6370 req-259bf691-2289-4cbe-b256-27b39803c6f1 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:30.313272 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-a1f7c530-c855-4522-8ba0-c5e4aabf6370 req-259bf691-2289-4cbe-b256-27b39803c6f1 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:30.329394 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.compute.server_external_events [req-a1f7c530-c855-4522-8ba0-c5e4aabf6370 req-259bf691-2289-4cbe-b256-27b39803c6f1 service nova] Creating event network-vif-plugged:2bd62dce-ca58-4c9e-bb8a-99411d102c48 for instance bbeb7a47-a8ee-44b3-bc79-bd12670aaa33 on hv-cinder-83705 Apr 08 02:52:30.334411 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [req-a1f7c530-c855-4522-8ba0-c5e4aabf6370 req-259bf691-2289-4cbe-b256-27b39803c6f1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048012 Apr 08 02:52:30.335209 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 360/717] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:52:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:52:30.861948 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-623828c7-67d3-48f9-ae99-15c16f3e0703 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:30.862533 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-623828c7-67d3-48f9-ae99-15c16f3e0703 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: bbeb7a47-a8ee-44b3-bc79-bd12670aaa33] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:52:30.870852 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-623828c7-67d3-48f9-ae99-15c16f3e0703 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:30.871293 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-623828c7-67d3-48f9-ae99-15c16f3e0703 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:30.872059 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-623828c7-67d3-48f9-ae99-15c16f3e0703 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:30.872510 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-623828c7-67d3-48f9-ae99-15c16f3e0703 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:31.234444 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-623828c7-67d3-48f9-ae99-15c16f3e0703 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:52:31.247591 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-623828c7-67d3-48f9-ae99-15c16f3e0703 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:52:31.253586 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-623828c7-67d3-48f9-ae99-15c16f3e0703 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:52:31.254616 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-623828c7-67d3-48f9-ae99-15c16f3e0703 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33" status: 200 len: 1407 microversion: 2.20 time: 0.401634 Apr 08 02:52:31.255157 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 358/718] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:52:30 2022] GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33 => generated 1407 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:52:32.280046 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-f8330d44-33b5-4c3d-a4f0-fdf6a9c79be7 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:32.280735 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-f8330d44-33b5-4c3d-a4f0-fdf6a9c79be7 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: bbeb7a47-a8ee-44b3-bc79-bd12670aaa33] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:52:32.289282 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-f8330d44-33b5-4c3d-a4f0-fdf6a9c79be7 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:32.290074 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-f8330d44-33b5-4c3d-a4f0-fdf6a9c79be7 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:32.291049 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-f8330d44-33b5-4c3d-a4f0-fdf6a9c79be7 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:32.291634 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-f8330d44-33b5-4c3d-a4f0-fdf6a9c79be7 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:32.875315 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-f8330d44-33b5-4c3d-a4f0-fdf6a9c79be7 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:52:32.889207 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-f8330d44-33b5-4c3d-a4f0-fdf6a9c79be7 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:52:32.895254 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-f8330d44-33b5-4c3d-a4f0-fdf6a9c79be7 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:52:32.896361 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-f8330d44-33b5-4c3d-a4f0-fdf6a9c79be7 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33" status: 200 len: 1599 microversion: 2.20 time: 0.626967 Apr 08 02:52:32.896891 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 361/719] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:52:32 2022] GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33 => generated 1599 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:52:32.920263 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-f8001ced-85ae-465f-a62d-1e216d8593de tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:52:32.920787 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-f8001ced-85ae-465f-a62d-1e216d8593de tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: bbeb7a47-a8ee-44b3-bc79-bd12670aaa33] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:52:32.927857 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-f8001ced-85ae-465f-a62d-1e216d8593de tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:32.928301 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-f8001ced-85ae-465f-a62d-1e216d8593de tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:32.929071 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-f8001ced-85ae-465f-a62d-1e216d8593de tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:32.929608 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-f8001ced-85ae-465f-a62d-1e216d8593de tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:33.278799 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-f8001ced-85ae-465f-a62d-1e216d8593de tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.368612 Apr 08 02:52:33.279580 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 359/720] 10.222.0.48 () {60 vars in 1315 bytes} [Fri Apr 8 02:52:32 2022] GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33/os-interface => generated 284 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 08 02:52:35.027966 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [req-c8332c27-76a2-4f47-9e34-ba62baf392ed req-9b5999c0-5433-4591-a106-f866044326f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbeb7a47-a8ee-44b3-bc79-bd12670aaa33", "tag": "2bd62dce-ca58-4c9e-bb8a-99411d102c48"}]} {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:52:35.035442 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:52:35.035442 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: warnings.warn(msg) Apr 08 02:52:35.044056 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-c8332c27-76a2-4f47-9e34-ba62baf392ed req-9b5999c0-5433-4591-a106-f866044326f2 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:52:35.044836 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-c8332c27-76a2-4f47-9e34-ba62baf392ed req-9b5999c0-5433-4591-a106-f866044326f2 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:52:35.063363 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.compute.server_external_events [req-c8332c27-76a2-4f47-9e34-ba62baf392ed req-9b5999c0-5433-4591-a106-f866044326f2 service nova] Creating event network-changed:2bd62dce-ca58-4c9e-bb8a-99411d102c48 for instance bbeb7a47-a8ee-44b3-bc79-bd12670aaa33 on hv-cinder-83705 Apr 08 02:52:35.068013 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [req-c8332c27-76a2-4f47-9e34-ba62baf392ed req-9b5999c0-5433-4591-a106-f866044326f2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051011 Apr 08 02:52:35.069109 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 362/721] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:52:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:53:03.298433 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-d9a0cb95-9807-42c1-b31d-8aa0dd56571a tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:53:03.301305 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-d9a0cb95-9807-42c1-b31d-8aa0dd56571a tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] [instance: dac91570-d62d-4a3c-a83c-20a727657c9d] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:53:03.309297 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-d9a0cb95-9807-42c1-b31d-8aa0dd56571a tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:03.309744 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-d9a0cb95-9807-42c1-b31d-8aa0dd56571a tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:03.310516 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-d9a0cb95-9807-42c1-b31d-8aa0dd56571a tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:03.311029 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-d9a0cb95-9807-42c1-b31d-8aa0dd56571a tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:03.464183 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-d9a0cb95-9807-42c1-b31d-8aa0dd56571a tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] 10.222.0.48 "POST /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d/action" status: 202 len: 0 microversion: 2.1 time: 0.176602 Apr 08 02:53:03.465023 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 360/722] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Apr 8 02:53:03 2022] POST /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d/action => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 02:53:03.479579 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-eec8d4d5-6ef7-404c-bbfb-007cf8434a62 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:03.480273 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-eec8d4d5-6ef7-404c-bbfb-007cf8434a62 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] [instance: dac91570-d62d-4a3c-a83c-20a727657c9d] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:53:03.488655 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-eec8d4d5-6ef7-404c-bbfb-007cf8434a62 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:03.489292 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-eec8d4d5-6ef7-404c-bbfb-007cf8434a62 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:03.490292 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-eec8d4d5-6ef7-404c-bbfb-007cf8434a62 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:03.490752 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-eec8d4d5-6ef7-404c-bbfb-007cf8434a62 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:03.708200 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-eec8d4d5-6ef7-404c-bbfb-007cf8434a62 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b08a414e0c45ab839107cccb69f179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb5fe9c67d048c5b2097f9a923ac025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:53:03.717401 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-eec8d4d5-6ef7-404c-bbfb-007cf8434a62 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] 10.222.0.48 "GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d" status: 200 len: 1753 microversion: 2.1 time: 0.248176 Apr 08 02:53:03.717941 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 363/723] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:53:03 2022] GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d => generated 1753 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:53:04.741785 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-36b6935f-d74a-438b-957d-1b9f67c2e7d7 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:04.742442 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-36b6935f-d74a-438b-957d-1b9f67c2e7d7 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] [instance: dac91570-d62d-4a3c-a83c-20a727657c9d] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:53:04.750548 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-36b6935f-d74a-438b-957d-1b9f67c2e7d7 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:04.751112 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-36b6935f-d74a-438b-957d-1b9f67c2e7d7 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:04.751947 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-36b6935f-d74a-438b-957d-1b9f67c2e7d7 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:04.752476 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-36b6935f-d74a-438b-957d-1b9f67c2e7d7 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:04.952652 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-36b6935f-d74a-438b-957d-1b9f67c2e7d7 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b08a414e0c45ab839107cccb69f179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb5fe9c67d048c5b2097f9a923ac025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:53:04.961646 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-36b6935f-d74a-438b-957d-1b9f67c2e7d7 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] 10.222.0.48 "GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d" status: 200 len: 1758 microversion: 2.1 time: 0.230130 Apr 08 02:53:04.962170 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 361/724] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:53:04 2022] GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d => generated 1758 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:53:05.985066 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-809f59d8-cc05-4131-92d7-a08b6f3ee231 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:05.986341 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-809f59d8-cc05-4131-92d7-a08b6f3ee231 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] [instance: dac91570-d62d-4a3c-a83c-20a727657c9d] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:53:05.995364 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-809f59d8-cc05-4131-92d7-a08b6f3ee231 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:05.995800 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-809f59d8-cc05-4131-92d7-a08b6f3ee231 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:05.996559 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-809f59d8-cc05-4131-92d7-a08b6f3ee231 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:05.996982 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-809f59d8-cc05-4131-92d7-a08b6f3ee231 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:06.199266 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-809f59d8-cc05-4131-92d7-a08b6f3ee231 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b08a414e0c45ab839107cccb69f179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb5fe9c67d048c5b2097f9a923ac025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:53:06.207743 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-809f59d8-cc05-4131-92d7-a08b6f3ee231 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] 10.222.0.48 "GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d" status: 200 len: 1758 microversion: 2.1 time: 0.233287 Apr 08 02:53:06.208209 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 364/725] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:53:05 2022] GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d => generated 1758 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:53:07.230033 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-cdbf2bc3-0c89-45f4-8e93-fb0e4840421a tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:07.230750 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-cdbf2bc3-0c89-45f4-8e93-fb0e4840421a tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] [instance: dac91570-d62d-4a3c-a83c-20a727657c9d] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:53:07.237919 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-cdbf2bc3-0c89-45f4-8e93-fb0e4840421a tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:07.238363 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-cdbf2bc3-0c89-45f4-8e93-fb0e4840421a tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:07.239158 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-cdbf2bc3-0c89-45f4-8e93-fb0e4840421a tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:07.239588 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-cdbf2bc3-0c89-45f4-8e93-fb0e4840421a tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:07.538693 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-cdbf2bc3-0c89-45f4-8e93-fb0e4840421a tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b08a414e0c45ab839107cccb69f179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb5fe9c67d048c5b2097f9a923ac025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:53:07.547981 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-cdbf2bc3-0c89-45f4-8e93-fb0e4840421a tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] 10.222.0.48 "GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d" status: 200 len: 1758 microversion: 2.1 time: 0.326823 Apr 08 02:53:07.557829 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 362/726] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:53:07 2022] GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d => generated 1758 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:53:07.841087 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-d14b2255-da2b-42ec-840a-04186cf6e7ff tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:07.842069 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-d14b2255-da2b-42ec-840a-04186cf6e7ff tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 19ff8616-8e62-40fe-87e7-f976433b9288] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:53:07.849678 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-d14b2255-da2b-42ec-840a-04186cf6e7ff tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:07.850184 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-d14b2255-da2b-42ec-840a-04186cf6e7ff tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:07.851001 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-d14b2255-da2b-42ec-840a-04186cf6e7ff tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:07.851428 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-d14b2255-da2b-42ec-840a-04186cf6e7ff tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:07.923566 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-d14b2255-da2b-42ec-840a-04186cf6e7ff tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.092252 Apr 08 02:53:07.924130 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 365/727] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Apr 8 02:53:07 2022] GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288/os-volume_attachments => generated 25 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 08 02:53:08.018881 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-fff2c6ef-b43f-4c5d-b68f-ee4dd1231503 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:08.020233 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-fff2c6ef-b43f-4c5d-b68f-ee4dd1231503 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 19ff8616-8e62-40fe-87e7-f976433b9288] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:53:08.027180 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-fff2c6ef-b43f-4c5d-b68f-ee4dd1231503 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:08.027639 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-fff2c6ef-b43f-4c5d-b68f-ee4dd1231503 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:08.028393 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-fff2c6ef-b43f-4c5d-b68f-ee4dd1231503 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:08.028826 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-fff2c6ef-b43f-4c5d-b68f-ee4dd1231503 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:08.097231 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-fff2c6ef-b43f-4c5d-b68f-ee4dd1231503 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 19ff8616-8e62-40fe-87e7-f976433b9288] Going to try to terminate instance {{(pid=96919) delete /opt/stack/nova/nova/compute/api.py:2559}} Apr 08 02:53:08.213119 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-fff2c6ef-b43f-4c5d-b68f-ee4dd1231503 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "DELETE /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288" status: 204 len: 0 microversion: 2.1 time: 0.202868 Apr 08 02:53:08.213735 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 363/728] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Apr 8 02:53:08 2022] DELETE /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 08 02:53:08.227206 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-d979efee-6617-4079-8fc4-710dcc5038c9 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:08.228167 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-d979efee-6617-4079-8fc4-710dcc5038c9 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 19ff8616-8e62-40fe-87e7-f976433b9288] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:53:08.250365 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-d979efee-6617-4079-8fc4-710dcc5038c9 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:08.250938 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-d979efee-6617-4079-8fc4-710dcc5038c9 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:08.251806 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-d979efee-6617-4079-8fc4-710dcc5038c9 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:08.252240 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-d979efee-6617-4079-8fc4-710dcc5038c9 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:08.508718 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-d979efee-6617-4079-8fc4-710dcc5038c9 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a88a8d7c9e4d0a88308c0e894570be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c31bb4f3ce486591bc142b1da7553e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:53:08.516945 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-d979efee-6617-4079-8fc4-710dcc5038c9 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288" status: 200 len: 1671 microversion: 2.1 time: 0.299033 Apr 08 02:53:08.517472 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 366/729] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:53:08 2022] GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288 => generated 1671 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:53:08.572446 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-22d6e300-046e-40b4-85d0-ae893ed95fd8 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:08.573036 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-22d6e300-046e-40b4-85d0-ae893ed95fd8 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] [instance: dac91570-d62d-4a3c-a83c-20a727657c9d] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:53:08.580372 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-22d6e300-046e-40b4-85d0-ae893ed95fd8 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:08.580816 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-22d6e300-046e-40b4-85d0-ae893ed95fd8 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:08.581671 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-22d6e300-046e-40b4-85d0-ae893ed95fd8 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:08.582106 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-22d6e300-046e-40b4-85d0-ae893ed95fd8 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:08.791290 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-22d6e300-046e-40b4-85d0-ae893ed95fd8 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b08a414e0c45ab839107cccb69f179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb5fe9c67d048c5b2097f9a923ac025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:53:08.799909 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-22d6e300-046e-40b4-85d0-ae893ed95fd8 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] 10.222.0.48 "GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d" status: 200 len: 1758 microversion: 2.1 time: 0.238379 Apr 08 02:53:08.800443 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 364/730] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:53:08 2022] GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d => generated 1758 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:53:09.538941 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-38cc9f03-8e53-4091-8d58-4df4040ed7ed tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:09.539540 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-38cc9f03-8e53-4091-8d58-4df4040ed7ed tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 19ff8616-8e62-40fe-87e7-f976433b9288] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:53:09.546693 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-38cc9f03-8e53-4091-8d58-4df4040ed7ed tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:09.547185 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-38cc9f03-8e53-4091-8d58-4df4040ed7ed tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:09.548140 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-38cc9f03-8e53-4091-8d58-4df4040ed7ed tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:09.548572 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-38cc9f03-8e53-4091-8d58-4df4040ed7ed tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:09.751284 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-38cc9f03-8e53-4091-8d58-4df4040ed7ed tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a88a8d7c9e4d0a88308c0e894570be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c31bb4f3ce486591bc142b1da7553e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:53:09.759943 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-38cc9f03-8e53-4091-8d58-4df4040ed7ed tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288" status: 200 len: 1671 microversion: 2.1 time: 0.230618 Apr 08 02:53:09.760590 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 367/731] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:53:09 2022] GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288 => generated 1671 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:53:09.822766 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-98dcc4d7-c851-42c2-b20b-ddfcc14d9dfa tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:09.823377 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-98dcc4d7-c851-42c2-b20b-ddfcc14d9dfa tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] [instance: dac91570-d62d-4a3c-a83c-20a727657c9d] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:53:09.830734 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-98dcc4d7-c851-42c2-b20b-ddfcc14d9dfa tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:09.831192 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-98dcc4d7-c851-42c2-b20b-ddfcc14d9dfa tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:09.831973 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-98dcc4d7-c851-42c2-b20b-ddfcc14d9dfa tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:09.832404 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-98dcc4d7-c851-42c2-b20b-ddfcc14d9dfa tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:10.128833 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-98dcc4d7-c851-42c2-b20b-ddfcc14d9dfa tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b08a414e0c45ab839107cccb69f179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb5fe9c67d048c5b2097f9a923ac025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:53:10.138337 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-98dcc4d7-c851-42c2-b20b-ddfcc14d9dfa tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] 10.222.0.48 "GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d" status: 200 len: 1758 microversion: 2.1 time: 0.324986 Apr 08 02:53:10.148370 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 365/732] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:53:09 2022] GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d => generated 1758 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:53:10.784250 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-1dfe391f-49e7-4f2a-bd62-5938595be882 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:10.784250 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-1dfe391f-49e7-4f2a-bd62-5938595be882 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 19ff8616-8e62-40fe-87e7-f976433b9288] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:53:10.793320 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-1dfe391f-49e7-4f2a-bd62-5938595be882 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:10.794053 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-1dfe391f-49e7-4f2a-bd62-5938595be882 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:10.794980 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-1dfe391f-49e7-4f2a-bd62-5938595be882 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:10.795679 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-1dfe391f-49e7-4f2a-bd62-5938595be882 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:10.940764 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-1dfe391f-49e7-4f2a-bd62-5938595be882 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a88a8d7c9e4d0a88308c0e894570be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c31bb4f3ce486591bc142b1da7553e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:53:10.967653 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-1dfe391f-49e7-4f2a-bd62-5938595be882 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288" status: 200 len: 1604 microversion: 2.1 time: 0.193271 Apr 08 02:53:10.978503 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 368/733] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:53:10 2022] GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288 => generated 1604 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:53:11.034977 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [req-0bdc67d0-e96b-4ed5-b890-54255a9acfbf req-c1074c1e-9eb6-47cd-93ce-7edc81cf8be6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19ff8616-8e62-40fe-87e7-f976433b9288", "name": "network-vif-deleted", "tag": "13eae4a8-fba8-4afe-8767-4b3ffface99b"}]} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:53:11.046333 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:53:11.046333 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: warnings.warn(msg) Apr 08 02:53:11.059885 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-0bdc67d0-e96b-4ed5-b890-54255a9acfbf req-c1074c1e-9eb6-47cd-93ce-7edc81cf8be6 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:11.060726 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-0bdc67d0-e96b-4ed5-b890-54255a9acfbf req-c1074c1e-9eb6-47cd-93ce-7edc81cf8be6 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:11.090401 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.compute.server_external_events [req-0bdc67d0-e96b-4ed5-b890-54255a9acfbf req-c1074c1e-9eb6-47cd-93ce-7edc81cf8be6 service nova] Creating event network-vif-deleted:13eae4a8-fba8-4afe-8767-4b3ffface99b for instance 19ff8616-8e62-40fe-87e7-f976433b9288 on hv-cinder-83705 Apr 08 02:53:11.096600 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [req-0bdc67d0-e96b-4ed5-b890-54255a9acfbf req-c1074c1e-9eb6-47cd-93ce-7edc81cf8be6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083011 Apr 08 02:53:11.097372 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 366/734] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:53:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:53:11.162368 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-4ddd93e8-8bdf-4a51-8302-db9bb591c233 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:11.163505 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-4ddd93e8-8bdf-4a51-8302-db9bb591c233 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] [instance: dac91570-d62d-4a3c-a83c-20a727657c9d] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:53:11.190237 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-4ddd93e8-8bdf-4a51-8302-db9bb591c233 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:11.191073 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-4ddd93e8-8bdf-4a51-8302-db9bb591c233 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:11.191873 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-4ddd93e8-8bdf-4a51-8302-db9bb591c233 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:11.192311 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-4ddd93e8-8bdf-4a51-8302-db9bb591c233 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:11.540275 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-4ddd93e8-8bdf-4a51-8302-db9bb591c233 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b08a414e0c45ab839107cccb69f179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb5fe9c67d048c5b2097f9a923ac025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:53:11.550251 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-4ddd93e8-8bdf-4a51-8302-db9bb591c233 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] 10.222.0.48 "GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d" status: 200 len: 1758 microversion: 2.1 time: 0.397803 Apr 08 02:53:11.550821 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 369/735] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:53:11 2022] GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d => generated 1758 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:53:11.990946 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-25f5cda4-0032-433f-a5a4-9ecd938fe0bf tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:11.991984 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-25f5cda4-0032-433f-a5a4-9ecd938fe0bf tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 19ff8616-8e62-40fe-87e7-f976433b9288] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:53:11.999858 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-25f5cda4-0032-433f-a5a4-9ecd938fe0bf tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:12.000597 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-25f5cda4-0032-433f-a5a4-9ecd938fe0bf tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:12.001577 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-25f5cda4-0032-433f-a5a4-9ecd938fe0bf tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:12.002210 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-25f5cda4-0032-433f-a5a4-9ecd938fe0bf tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:12.054244 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.wsgi [None req-25f5cda4-0032-433f-a5a4-9ecd938fe0bf tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] HTTP exception thrown: Instance 19ff8616-8e62-40fe-87e7-f976433b9288 could not be found. Apr 08 02:53:12.055042 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-25f5cda4-0032-433f-a5a4-9ecd938fe0bf tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Returning 404 to user: Instance 19ff8616-8e62-40fe-87e7-f976433b9288 could not be found. {{(pid=96919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Apr 08 02:53:12.055838 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-25f5cda4-0032-433f-a5a4-9ecd938fe0bf tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288" status: 404 len: 111 microversion: 2.1 time: 0.074635 Apr 08 02:53:12.060761 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 367/736] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:53:11 2022] GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 02:53:12.071344 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-8734415c-83ef-4de8-8e19-401fa0805e92 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '.version_select at 0x7f7d4e18fca0>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:12.095403 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-8734415c-83ef-4de8-8e19-401fa0805e92 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-218229824" status: 202 len: 0 microversion: 2.1 time: 0.033664 Apr 08 02:53:12.095980 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 370/737] 10.222.0.48 () {58 vars in 1217 bytes} [Fri Apr 8 02:53:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-218229824 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 02:53:12.577973 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-171684bc-2833-42e6-bc86-ae0dd1f79706 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:12.579743 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-171684bc-2833-42e6-bc86-ae0dd1f79706 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] [instance: dac91570-d62d-4a3c-a83c-20a727657c9d] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:53:12.591498 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-171684bc-2833-42e6-bc86-ae0dd1f79706 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:12.592388 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-171684bc-2833-42e6-bc86-ae0dd1f79706 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:12.593977 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-171684bc-2833-42e6-bc86-ae0dd1f79706 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:12.595525 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-171684bc-2833-42e6-bc86-ae0dd1f79706 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:13.027648 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-171684bc-2833-42e6-bc86-ae0dd1f79706 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b08a414e0c45ab839107cccb69f179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb5fe9c67d048c5b2097f9a923ac025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:53:13.036161 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-171684bc-2833-42e6-bc86-ae0dd1f79706 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] 10.222.0.48 "GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d" status: 200 len: 1758 microversion: 2.1 time: 0.472079 Apr 08 02:53:13.036698 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 368/738] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:53:12 2022] GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d => generated 1758 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:53:14.061845 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-5b82f43e-8a61-4c17-ac3e-b7dfdb56c6c9 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:14.063397 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-5b82f43e-8a61-4c17-ac3e-b7dfdb56c6c9 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] [instance: dac91570-d62d-4a3c-a83c-20a727657c9d] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:53:14.074275 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-5b82f43e-8a61-4c17-ac3e-b7dfdb56c6c9 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:14.075025 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-5b82f43e-8a61-4c17-ac3e-b7dfdb56c6c9 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:14.076024 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-5b82f43e-8a61-4c17-ac3e-b7dfdb56c6c9 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:14.076610 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-5b82f43e-8a61-4c17-ac3e-b7dfdb56c6c9 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:14.176599 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-5a84153c-47db-448c-b3e6-b2b16f05f3c6 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Action: 'create', calling method: .version_select at 0x7f7d4e2b6700>, body: {"keypair": {"name": "tempest-keypair-738217636"}} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:53:14.208575 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.quota [None req-5a84153c-47db-448c-b3e6-b2b16f05f3c6 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Getting quotas for project d7c31bb4f3ce486591bc142b1da7553e. Resources: {'key_pairs'} {{(pid=96919) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:53:14.212533 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.quota [None req-5a84153c-47db-448c-b3e6-b2b16f05f3c6 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Getting quotas for user e2a88a8d7c9e4d0a88308c0e894570be and project d7c31bb4f3ce486591bc142b1da7553e. Resources: {'key_pairs'} {{(pid=96919) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:53:14.387188 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-5b82f43e-8a61-4c17-ac3e-b7dfdb56c6c9 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b08a414e0c45ab839107cccb69f179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb5fe9c67d048c5b2097f9a923ac025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:53:14.396427 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-5b82f43e-8a61-4c17-ac3e-b7dfdb56c6c9 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] 10.222.0.48 "GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d" status: 200 len: 1758 microversion: 2.1 time: 0.346869 Apr 08 02:53:14.397390 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 371/739] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:53:14 2022] GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d => generated 1758 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:53:14.452254 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.quota [None req-5a84153c-47db-448c-b3e6-b2b16f05f3c6 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Getting quotas for project d7c31bb4f3ce486591bc142b1da7553e. Resources: {'key_pairs'} {{(pid=96919) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:53:14.456020 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.quota [None req-5a84153c-47db-448c-b3e6-b2b16f05f3c6 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Getting quotas for user e2a88a8d7c9e4d0a88308c0e894570be and project d7c31bb4f3ce486591bc142b1da7553e. Resources: {'key_pairs'} {{(pid=96919) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:53:14.470080 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-5a84153c-47db-448c-b3e6-b2b16f05f3c6 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.302360 Apr 08 02:53:14.470868 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 369/740] 10.222.0.48 () {60 vars in 1157 bytes} [Fri Apr 8 02:53:14 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:53:15.418740 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-2ff79d1e-765a-4f96-90a6-cef798405ea8 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:15.419374 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-2ff79d1e-765a-4f96-90a6-cef798405ea8 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] [instance: dac91570-d62d-4a3c-a83c-20a727657c9d] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:53:15.426580 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-2ff79d1e-765a-4f96-90a6-cef798405ea8 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:15.427043 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-2ff79d1e-765a-4f96-90a6-cef798405ea8 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:15.427796 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-2ff79d1e-765a-4f96-90a6-cef798405ea8 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:15.428742 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-2ff79d1e-765a-4f96-90a6-cef798405ea8 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:15.647990 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-2ff79d1e-765a-4f96-90a6-cef798405ea8 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b08a414e0c45ab839107cccb69f179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb5fe9c67d048c5b2097f9a923ac025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:53:15.660155 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-2ff79d1e-765a-4f96-90a6-cef798405ea8 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] 10.222.0.48 "GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d" status: 200 len: 1758 microversion: 2.1 time: 0.250553 Apr 08 02:53:15.660810 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 372/741] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:53:15 2022] GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d => generated 1758 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:53:16.332613 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-3c819b56-f796-4047-902c-924ca681dafd tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2057057089", "imageRef": "7f8ca061-f382-4052-8d05-69f37e107684", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5dea2017-1900-4ff0-b5ef-6938292bd5df"}], "security_groups": [{"name": "tempest-securitygroup--114808733"}], "key_name": "tempest-keypair-738217636", "user_data": "}} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:53:16.466798 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.network.neutron [None req-3c819b56-f796-4047-902c-924ca681dafd tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] validate_networks() for [('5dea2017-1900-4ff0-b5ef-6938292bd5df', None, None, None)] {{(pid=96919) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} Apr 08 02:53:16.683015 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-eec0e793-0095-4f20-9d56-b0eb5fe2b91f tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:16.683707 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-eec0e793-0095-4f20-9d56-b0eb5fe2b91f tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] [instance: dac91570-d62d-4a3c-a83c-20a727657c9d] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:53:16.691027 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-eec0e793-0095-4f20-9d56-b0eb5fe2b91f tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:16.691544 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-eec0e793-0095-4f20-9d56-b0eb5fe2b91f tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:16.692389 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-eec0e793-0095-4f20-9d56-b0eb5fe2b91f tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:16.692901 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-eec0e793-0095-4f20-9d56-b0eb5fe2b91f tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:17.103507 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-eec0e793-0095-4f20-9d56-b0eb5fe2b91f tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b08a414e0c45ab839107cccb69f179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb5fe9c67d048c5b2097f9a923ac025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:53:17.112002 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-eec0e793-0095-4f20-9d56-b0eb5fe2b91f tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] 10.222.0.48 "GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d" status: 200 len: 1758 microversion: 2.1 time: 0.438759 Apr 08 02:53:17.112533 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 373/742] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:53:16 2022] GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d => generated 1758 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:53:17.118765 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.virt.hardware [None req-3c819b56-f796-4047-902c-924ca681dafd tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Flavor limits 0:0:0 {{(pid=96919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} Apr 08 02:53:17.119257 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.virt.hardware [None req-3c819b56-f796-4047-902c-924ca681dafd tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Image limits 0:0:0 {{(pid=96919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} Apr 08 02:53:17.119798 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.virt.hardware [None req-3c819b56-f796-4047-902c-924ca681dafd tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Flavor pref 0:0:0 {{(pid=96919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} Apr 08 02:53:17.120274 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.virt.hardware [None req-3c819b56-f796-4047-902c-924ca681dafd tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Image pref 0:0:0 {{(pid=96919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} Apr 08 02:53:17.120751 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.virt.hardware [None req-3c819b56-f796-4047-902c-924ca681dafd tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=96919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} Apr 08 02:53:17.129284 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-3c819b56-f796-4047-902c-924ca681dafd tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:17.129753 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-3c819b56-f796-4047-902c-924ca681dafd tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:17.130637 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-3c819b56-f796-4047-902c-924ca681dafd tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:17.131173 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-3c819b56-f796-4047-902c-924ca681dafd tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:17.149176 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.quota [None req-3c819b56-f796-4047-902c-924ca681dafd tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Getting quotas for project d7c31bb4f3ce486591bc142b1da7553e. Resources: {'instances', 'cores', 'ram'} {{(pid=96919) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:53:17.153109 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.quota [None req-3c819b56-f796-4047-902c-924ca681dafd tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Getting quotas for user e2a88a8d7c9e4d0a88308c0e894570be and project d7c31bb4f3ce486591bc142b1da7553e. Resources: {'instances', 'cores', 'ram'} {{(pid=96919) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:53:17.164342 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-3c819b56-f796-4047-902c-924ca681dafd tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Going to run 1 instances... {{(pid=96919) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} Apr 08 02:53:17.166924 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-3c819b56-f796-4047-902c-924ca681dafd tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 170aa648-5004-4e0d-9f78-aad5b2764ce1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7f8ca061-f382-4052-8d05-69f37e107684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=96919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} Apr 08 02:53:17.213802 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-3c819b56-f796-4047-902c-924ca681dafd tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.890270 Apr 08 02:53:17.214558 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 370/743] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Apr 8 02:53:16 2022] POST /compute/v2.1/servers => generated 401 bytes in 892 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 08 02:53:17.229801 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-40c15a2d-6cce-4f49-a21b-2879cb44b8e1 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:17.231336 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-40c15a2d-6cce-4f49-a21b-2879cb44b8e1 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 170aa648-5004-4e0d-9f78-aad5b2764ce1] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:53:17.316181 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-40c15a2d-6cce-4f49-a21b-2879cb44b8e1 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a88a8d7c9e4d0a88308c0e894570be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c31bb4f3ce486591bc142b1da7553e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:53:17.325157 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-40c15a2d-6cce-4f49-a21b-2879cb44b8e1 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/170aa648-5004-4e0d-9f78-aad5b2764ce1" status: 200 len: 1237 microversion: 2.1 time: 0.104752 Apr 08 02:53:17.325698 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 374/744] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:53:17 2022] GET /compute/v2.1/servers/170aa648-5004-4e0d-9f78-aad5b2764ce1 => generated 1237 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:53:18.134835 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-0b077eaa-de4e-4f99-91c0-aca05061240f tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:18.136620 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-0b077eaa-de4e-4f99-91c0-aca05061240f tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] [instance: dac91570-d62d-4a3c-a83c-20a727657c9d] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:53:18.143502 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-0b077eaa-de4e-4f99-91c0-aca05061240f tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:18.143943 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-0b077eaa-de4e-4f99-91c0-aca05061240f tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:18.144720 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-0b077eaa-de4e-4f99-91c0-aca05061240f tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:18.145148 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-0b077eaa-de4e-4f99-91c0-aca05061240f tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:18.352534 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-2a3a5d1b-655f-4421-b092-5d76f8e7d5cd tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:18.354283 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-2a3a5d1b-655f-4421-b092-5d76f8e7d5cd tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 170aa648-5004-4e0d-9f78-aad5b2764ce1] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:53:18.367275 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-2a3a5d1b-655f-4421-b092-5d76f8e7d5cd tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:18.368198 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-2a3a5d1b-655f-4421-b092-5d76f8e7d5cd tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:18.369769 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-2a3a5d1b-655f-4421-b092-5d76f8e7d5cd tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:18.370407 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-2a3a5d1b-655f-4421-b092-5d76f8e7d5cd tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:18.379824 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-0b077eaa-de4e-4f99-91c0-aca05061240f tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b08a414e0c45ab839107cccb69f179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb5fe9c67d048c5b2097f9a923ac025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:53:18.398291 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-0b077eaa-de4e-4f99-91c0-aca05061240f tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] 10.222.0.48 "GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d" status: 200 len: 1758 microversion: 2.1 time: 0.273031 Apr 08 02:53:18.398779 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 371/745] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:53:18 2022] GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d => generated 1758 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:53:18.519152 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-2a3a5d1b-655f-4421-b092-5d76f8e7d5cd tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a88a8d7c9e4d0a88308c0e894570be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c31bb4f3ce486591bc142b1da7553e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:53:18.527834 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-2a3a5d1b-655f-4421-b092-5d76f8e7d5cd tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/170aa648-5004-4e0d-9f78-aad5b2764ce1" status: 200 len: 1307 microversion: 2.1 time: 0.190233 Apr 08 02:53:18.528361 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 375/746] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:53:18 2022] GET /compute/v2.1/servers/170aa648-5004-4e0d-9f78-aad5b2764ce1 => generated 1307 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:53:19.422016 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-fec970c1-d603-43cd-b2be-37655c38243e tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:19.422731 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-fec970c1-d603-43cd-b2be-37655c38243e tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] [instance: dac91570-d62d-4a3c-a83c-20a727657c9d] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:53:19.430983 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-fec970c1-d603-43cd-b2be-37655c38243e tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:19.431431 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-fec970c1-d603-43cd-b2be-37655c38243e tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:19.432221 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-fec970c1-d603-43cd-b2be-37655c38243e tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:19.432654 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-fec970c1-d603-43cd-b2be-37655c38243e tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:19.550613 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-e51d7b54-5e8a-4308-b75c-2cad5f7ca823 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:19.551903 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-e51d7b54-5e8a-4308-b75c-2cad5f7ca823 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 170aa648-5004-4e0d-9f78-aad5b2764ce1] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:53:19.559917 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-e51d7b54-5e8a-4308-b75c-2cad5f7ca823 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:19.560424 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-e51d7b54-5e8a-4308-b75c-2cad5f7ca823 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:19.561434 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-e51d7b54-5e8a-4308-b75c-2cad5f7ca823 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:19.561860 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-e51d7b54-5e8a-4308-b75c-2cad5f7ca823 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:19.692105 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-fec970c1-d603-43cd-b2be-37655c38243e tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b08a414e0c45ab839107cccb69f179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb5fe9c67d048c5b2097f9a923ac025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:53:19.701596 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-fec970c1-d603-43cd-b2be-37655c38243e tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] 10.222.0.48 "GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d" status: 200 len: 1758 microversion: 2.1 time: 0.289928 Apr 08 02:53:19.705411 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 372/747] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:53:19 2022] GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d => generated 1758 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:53:19.781995 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-e51d7b54-5e8a-4308-b75c-2cad5f7ca823 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a88a8d7c9e4d0a88308c0e894570be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c31bb4f3ce486591bc142b1da7553e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:53:19.790208 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-e51d7b54-5e8a-4308-b75c-2cad5f7ca823 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/170aa648-5004-4e0d-9f78-aad5b2764ce1" status: 200 len: 1362 microversion: 2.1 time: 0.249041 Apr 08 02:53:19.790860 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 376/748] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:53:19 2022] GET /compute/v2.1/servers/170aa648-5004-4e0d-9f78-aad5b2764ce1 => generated 1362 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:53:20.244407 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [req-99c18cef-c86a-45e9-a9ba-5f909e0c6340 req-015f3416-1ed5-4aa5-b420-a87e17622126 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "170aa648-5004-4e0d-9f78-aad5b2764ce1", "tag": "c589e3c6-07ca-44fc-ae31-96e15494023f"}]} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:53:20.251160 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:53:20.251160 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: warnings.warn(msg) Apr 08 02:53:20.260102 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-99c18cef-c86a-45e9-a9ba-5f909e0c6340 req-015f3416-1ed5-4aa5-b420-a87e17622126 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:20.260550 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-99c18cef-c86a-45e9-a9ba-5f909e0c6340 req-015f3416-1ed5-4aa5-b420-a87e17622126 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:20.286359 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.compute.server_external_events [req-99c18cef-c86a-45e9-a9ba-5f909e0c6340 req-015f3416-1ed5-4aa5-b420-a87e17622126 service nova] Creating event network-changed:c589e3c6-07ca-44fc-ae31-96e15494023f for instance 170aa648-5004-4e0d-9f78-aad5b2764ce1 on hv-cinder-83705 Apr 08 02:53:20.291571 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [req-99c18cef-c86a-45e9-a9ba-5f909e0c6340 req-015f3416-1ed5-4aa5-b420-a87e17622126 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071423 Apr 08 02:53:20.292268 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 373/749] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:53:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:53:20.724680 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-ff83808e-6a47-466d-826d-7b22dcd4b9b6 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:20.725234 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-ff83808e-6a47-466d-826d-7b22dcd4b9b6 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] [instance: dac91570-d62d-4a3c-a83c-20a727657c9d] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:53:20.732332 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-ff83808e-6a47-466d-826d-7b22dcd4b9b6 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:20.732803 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-ff83808e-6a47-466d-826d-7b22dcd4b9b6 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:20.733559 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-ff83808e-6a47-466d-826d-7b22dcd4b9b6 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:20.733984 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-ff83808e-6a47-466d-826d-7b22dcd4b9b6 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:20.834915 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-4b36dc44-89c6-4d2d-88fc-be3df30a22ed tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:20.835736 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-4b36dc44-89c6-4d2d-88fc-be3df30a22ed tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 170aa648-5004-4e0d-9f78-aad5b2764ce1] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:53:20.850564 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-4b36dc44-89c6-4d2d-88fc-be3df30a22ed tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:20.851112 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-4b36dc44-89c6-4d2d-88fc-be3df30a22ed tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:20.851954 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-4b36dc44-89c6-4d2d-88fc-be3df30a22ed tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:20.852462 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-4b36dc44-89c6-4d2d-88fc-be3df30a22ed tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:21.027422 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-ff83808e-6a47-466d-826d-7b22dcd4b9b6 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b08a414e0c45ab839107cccb69f179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb5fe9c67d048c5b2097f9a923ac025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:53:21.036174 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-ff83808e-6a47-466d-826d-7b22dcd4b9b6 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] 10.222.0.48 "GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d" status: 200 len: 1761 microversion: 2.1 time: 0.320192 Apr 08 02:53:21.036909 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 377/750] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:53:20 2022] GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d => generated 1761 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:53:21.097399 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-4b36dc44-89c6-4d2d-88fc-be3df30a22ed tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a88a8d7c9e4d0a88308c0e894570be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c31bb4f3ce486591bc142b1da7553e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:53:21.106266 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-4b36dc44-89c6-4d2d-88fc-be3df30a22ed tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/170aa648-5004-4e0d-9f78-aad5b2764ce1" status: 200 len: 1362 microversion: 2.1 time: 0.302055 Apr 08 02:53:21.106829 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 374/751] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:53:20 2022] GET /compute/v2.1/servers/170aa648-5004-4e0d-9f78-aad5b2764ce1 => generated 1362 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:53:22.129227 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-bcb4c1d8-7840-4042-bead-a9e1b2361bc4 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:22.129893 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-bcb4c1d8-7840-4042-bead-a9e1b2361bc4 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 170aa648-5004-4e0d-9f78-aad5b2764ce1] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:53:22.138128 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-bcb4c1d8-7840-4042-bead-a9e1b2361bc4 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:22.138568 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-bcb4c1d8-7840-4042-bead-a9e1b2361bc4 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:22.139381 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-bcb4c1d8-7840-4042-bead-a9e1b2361bc4 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:22.139806 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-bcb4c1d8-7840-4042-bead-a9e1b2361bc4 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:22.349756 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-bcb4c1d8-7840-4042-bead-a9e1b2361bc4 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a88a8d7c9e4d0a88308c0e894570be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c31bb4f3ce486591bc142b1da7553e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:53:22.358068 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-bcb4c1d8-7840-4042-bead-a9e1b2361bc4 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/170aa648-5004-4e0d-9f78-aad5b2764ce1" status: 200 len: 1362 microversion: 2.1 time: 0.238060 Apr 08 02:53:22.358616 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 378/752] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:53:22 2022] GET /compute/v2.1/servers/170aa648-5004-4e0d-9f78-aad5b2764ce1 => generated 1362 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:53:23.380364 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-2534aa7a-4941-47d5-8c86-a769c4170af3 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:23.381665 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-2534aa7a-4941-47d5-8c86-a769c4170af3 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 170aa648-5004-4e0d-9f78-aad5b2764ce1] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:53:23.389523 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-2534aa7a-4941-47d5-8c86-a769c4170af3 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:23.389970 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-2534aa7a-4941-47d5-8c86-a769c4170af3 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:23.390762 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-2534aa7a-4941-47d5-8c86-a769c4170af3 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:23.391189 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-2534aa7a-4941-47d5-8c86-a769c4170af3 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:23.591649 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-2534aa7a-4941-47d5-8c86-a769c4170af3 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a88a8d7c9e4d0a88308c0e894570be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c31bb4f3ce486591bc142b1da7553e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:53:23.599938 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-2534aa7a-4941-47d5-8c86-a769c4170af3 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/170aa648-5004-4e0d-9f78-aad5b2764ce1" status: 200 len: 1362 microversion: 2.1 time: 0.228577 Apr 08 02:53:23.600648 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 375/753] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:53:23 2022] GET /compute/v2.1/servers/170aa648-5004-4e0d-9f78-aad5b2764ce1 => generated 1362 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:53:24.622449 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-ecd540b8-05fa-4c78-b259-52971466b424 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:24.623066 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-ecd540b8-05fa-4c78-b259-52971466b424 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 170aa648-5004-4e0d-9f78-aad5b2764ce1] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:53:24.630213 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-ecd540b8-05fa-4c78-b259-52971466b424 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:24.630649 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-ecd540b8-05fa-4c78-b259-52971466b424 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:24.632075 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-ecd540b8-05fa-4c78-b259-52971466b424 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:24.632491 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-ecd540b8-05fa-4c78-b259-52971466b424 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:24.907797 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-ecd540b8-05fa-4c78-b259-52971466b424 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a88a8d7c9e4d0a88308c0e894570be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c31bb4f3ce486591bc142b1da7553e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:53:24.916229 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-ecd540b8-05fa-4c78-b259-52971466b424 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/170aa648-5004-4e0d-9f78-aad5b2764ce1" status: 200 len: 1362 microversion: 2.1 time: 0.303235 Apr 08 02:53:24.916743 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 379/754] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:53:24 2022] GET /compute/v2.1/servers/170aa648-5004-4e0d-9f78-aad5b2764ce1 => generated 1362 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:53:25.938229 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-142f987d-b2f5-482f-b6c8-d57a1b3edbae tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:25.938857 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-142f987d-b2f5-482f-b6c8-d57a1b3edbae tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 170aa648-5004-4e0d-9f78-aad5b2764ce1] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:53:25.946913 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-142f987d-b2f5-482f-b6c8-d57a1b3edbae tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:25.947359 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-142f987d-b2f5-482f-b6c8-d57a1b3edbae tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:25.948128 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-142f987d-b2f5-482f-b6c8-d57a1b3edbae tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:25.948557 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-142f987d-b2f5-482f-b6c8-d57a1b3edbae tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:26.152895 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-142f987d-b2f5-482f-b6c8-d57a1b3edbae tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a88a8d7c9e4d0a88308c0e894570be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c31bb4f3ce486591bc142b1da7553e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:53:26.160874 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-142f987d-b2f5-482f-b6c8-d57a1b3edbae tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/170aa648-5004-4e0d-9f78-aad5b2764ce1" status: 200 len: 1362 microversion: 2.1 time: 0.231514 Apr 08 02:53:26.161397 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 376/755] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:53:25 2022] GET /compute/v2.1/servers/170aa648-5004-4e0d-9f78-aad5b2764ce1 => generated 1362 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:53:27.183118 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-03905a68-df6e-4f51-b37d-151a14665565 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:27.183707 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-03905a68-df6e-4f51-b37d-151a14665565 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 170aa648-5004-4e0d-9f78-aad5b2764ce1] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:53:27.190744 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-03905a68-df6e-4f51-b37d-151a14665565 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:27.191182 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-03905a68-df6e-4f51-b37d-151a14665565 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:27.192044 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-03905a68-df6e-4f51-b37d-151a14665565 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:27.192474 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-03905a68-df6e-4f51-b37d-151a14665565 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:27.277154 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-4902326f-d946-426e-9f85-1e6c1a841ef0 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:53:27.277716 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-4902326f-d946-426e-9f85-1e6c1a841ef0 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] [instance: 2fb4b617-e0c5-4496-858f-f139414f8fb5] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:53:27.284818 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-4902326f-d946-426e-9f85-1e6c1a841ef0 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:27.285258 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-4902326f-d946-426e-9f85-1e6c1a841ef0 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:27.286015 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-4902326f-d946-426e-9f85-1e6c1a841ef0 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:27.286434 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-4902326f-d946-426e-9f85-1e6c1a841ef0 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:27.347440 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.objects.instance [None req-4902326f-d946-426e-9f85-1e6c1a841ef0 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lazy-loading 'flavor' on Instance uuid 2fb4b617-e0c5-4496-858f-f139414f8fb5 {{(pid=96919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 08 02:53:27.392025 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-03905a68-df6e-4f51-b37d-151a14665565 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a88a8d7c9e4d0a88308c0e894570be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c31bb4f3ce486591bc142b1da7553e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:53:27.400023 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-03905a68-df6e-4f51-b37d-151a14665565 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/170aa648-5004-4e0d-9f78-aad5b2764ce1" status: 200 len: 1362 microversion: 2.1 time: 0.225875 Apr 08 02:53:27.400557 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 380/756] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:53:27 2022] GET /compute/v2.1/servers/170aa648-5004-4e0d-9f78-aad5b2764ce1 => generated 1362 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:53:27.485056 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-4902326f-d946-426e-9f85-1e6c1a841ef0 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] 10.222.0.48 "POST /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5/action" status: 202 len: 0 microversion: 2.1 time: 0.217386 Apr 08 02:53:27.485885 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 377/757] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Apr 8 02:53:27 2022] POST /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 08 02:53:27.499943 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-17b57daf-33f3-4de9-9795-e2c10db62a92 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:27.500630 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-17b57daf-33f3-4de9-9795-e2c10db62a92 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] [instance: 2fb4b617-e0c5-4496-858f-f139414f8fb5] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:53:27.508599 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-17b57daf-33f3-4de9-9795-e2c10db62a92 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:27.509045 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-17b57daf-33f3-4de9-9795-e2c10db62a92 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:27.509830 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-17b57daf-33f3-4de9-9795-e2c10db62a92 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:27.510270 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-17b57daf-33f3-4de9-9795-e2c10db62a92 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:27.710876 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-17b57daf-33f3-4de9-9795-e2c10db62a92 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86a950d41cc44fb9f10b600b20b0ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f311117084470f8e8d16c47ad1d2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:53:27.718817 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-17b57daf-33f3-4de9-9795-e2c10db62a92 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] 10.222.0.48 "GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5" status: 200 len: 1569 microversion: 2.1 time: 0.228664 Apr 08 02:53:27.719346 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 381/758] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:53:27 2022] GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5 => generated 1569 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:53:28.422625 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-e344300a-6f5f-4ecd-a7ed-c46ebda7f051 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:28.423329 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-e344300a-6f5f-4ecd-a7ed-c46ebda7f051 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 170aa648-5004-4e0d-9f78-aad5b2764ce1] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:53:28.431216 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-e344300a-6f5f-4ecd-a7ed-c46ebda7f051 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:28.431653 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-e344300a-6f5f-4ecd-a7ed-c46ebda7f051 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:28.432411 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-e344300a-6f5f-4ecd-a7ed-c46ebda7f051 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:28.432837 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-e344300a-6f5f-4ecd-a7ed-c46ebda7f051 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:28.633158 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-e344300a-6f5f-4ecd-a7ed-c46ebda7f051 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a88a8d7c9e4d0a88308c0e894570be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c31bb4f3ce486591bc142b1da7553e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:53:28.641311 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-e344300a-6f5f-4ecd-a7ed-c46ebda7f051 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/170aa648-5004-4e0d-9f78-aad5b2764ce1" status: 200 len: 1362 microversion: 2.1 time: 0.228104 Apr 08 02:53:28.641839 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 378/759] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:53:28 2022] GET /compute/v2.1/servers/170aa648-5004-4e0d-9f78-aad5b2764ce1 => generated 1362 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:53:28.741910 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-52819376-4b74-4ec0-8925-b750e7baa069 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:28.742419 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-52819376-4b74-4ec0-8925-b750e7baa069 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] [instance: 2fb4b617-e0c5-4496-858f-f139414f8fb5] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:53:28.749537 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-52819376-4b74-4ec0-8925-b750e7baa069 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:28.749972 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-52819376-4b74-4ec0-8925-b750e7baa069 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:28.750750 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-52819376-4b74-4ec0-8925-b750e7baa069 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:28.751176 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-52819376-4b74-4ec0-8925-b750e7baa069 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:28.955084 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-52819376-4b74-4ec0-8925-b750e7baa069 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86a950d41cc44fb9f10b600b20b0ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f311117084470f8e8d16c47ad1d2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:53:28.964128 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-52819376-4b74-4ec0-8925-b750e7baa069 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] 10.222.0.48 "GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5" status: 200 len: 1569 microversion: 2.1 time: 0.232045 Apr 08 02:53:28.964662 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 382/760] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:53:28 2022] GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5 => generated 1569 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:53:29.662947 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-99c07979-88e8-4e89-b63a-acf4ba9da6eb tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:29.663570 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-99c07979-88e8-4e89-b63a-acf4ba9da6eb tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 170aa648-5004-4e0d-9f78-aad5b2764ce1] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:53:29.670727 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-99c07979-88e8-4e89-b63a-acf4ba9da6eb tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:29.671166 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-99c07979-88e8-4e89-b63a-acf4ba9da6eb tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:29.671921 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-99c07979-88e8-4e89-b63a-acf4ba9da6eb tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:29.672345 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-99c07979-88e8-4e89-b63a-acf4ba9da6eb tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:29.873060 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-99c07979-88e8-4e89-b63a-acf4ba9da6eb tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a88a8d7c9e4d0a88308c0e894570be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c31bb4f3ce486591bc142b1da7553e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:53:29.881032 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-99c07979-88e8-4e89-b63a-acf4ba9da6eb tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/170aa648-5004-4e0d-9f78-aad5b2764ce1" status: 200 len: 1362 microversion: 2.1 time: 0.227639 Apr 08 02:53:29.881572 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 379/761] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:53:29 2022] GET /compute/v2.1/servers/170aa648-5004-4e0d-9f78-aad5b2764ce1 => generated 1362 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:53:29.986796 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-0f1220fe-03a9-4f1f-81e0-a4e229358b97 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:29.987315 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-0f1220fe-03a9-4f1f-81e0-a4e229358b97 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] [instance: 2fb4b617-e0c5-4496-858f-f139414f8fb5] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:53:29.994729 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-0f1220fe-03a9-4f1f-81e0-a4e229358b97 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:29.995179 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-0f1220fe-03a9-4f1f-81e0-a4e229358b97 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:29.996071 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-0f1220fe-03a9-4f1f-81e0-a4e229358b97 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:29.996663 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-0f1220fe-03a9-4f1f-81e0-a4e229358b97 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:30.196751 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-0f1220fe-03a9-4f1f-81e0-a4e229358b97 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86a950d41cc44fb9f10b600b20b0ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f311117084470f8e8d16c47ad1d2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:53:30.204807 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-0f1220fe-03a9-4f1f-81e0-a4e229358b97 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] 10.222.0.48 "GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5" status: 200 len: 1569 microversion: 2.1 time: 0.227023 Apr 08 02:53:30.205332 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 383/762] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:53:29 2022] GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5 => generated 1569 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:53:30.613752 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [req-cbe39203-5b74-4a03-835c-52c462672181 req-366799b3-11f6-4ac4-bb4a-e0c581c65432 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "170aa648-5004-4e0d-9f78-aad5b2764ce1", "name": "network-vif-plugged", "status": "completed", "tag": "c589e3c6-07ca-44fc-ae31-96e15494023f"}]} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:53:30.620808 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:53:30.620808 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: warnings.warn(msg) Apr 08 02:53:30.628817 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-cbe39203-5b74-4a03-835c-52c462672181 req-366799b3-11f6-4ac4-bb4a-e0c581c65432 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:30.629249 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-cbe39203-5b74-4a03-835c-52c462672181 req-366799b3-11f6-4ac4-bb4a-e0c581c65432 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:30.645641 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.compute.server_external_events [req-cbe39203-5b74-4a03-835c-52c462672181 req-366799b3-11f6-4ac4-bb4a-e0c581c65432 service nova] Creating event network-vif-plugged:c589e3c6-07ca-44fc-ae31-96e15494023f for instance 170aa648-5004-4e0d-9f78-aad5b2764ce1 on hv-cinder-83705 Apr 08 02:53:30.650375 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [req-cbe39203-5b74-4a03-835c-52c462672181 req-366799b3-11f6-4ac4-bb4a-e0c581c65432 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045523 Apr 08 02:53:30.650983 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 380/763] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:53:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:53:30.902752 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-e23b10ed-3a93-4127-b846-385c84c50ad6 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:30.903291 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-e23b10ed-3a93-4127-b846-385c84c50ad6 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 170aa648-5004-4e0d-9f78-aad5b2764ce1] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:53:30.910515 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-e23b10ed-3a93-4127-b846-385c84c50ad6 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:30.910992 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-e23b10ed-3a93-4127-b846-385c84c50ad6 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:30.911762 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-e23b10ed-3a93-4127-b846-385c84c50ad6 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:30.912684 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-e23b10ed-3a93-4127-b846-385c84c50ad6 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:31.128151 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-e23b10ed-3a93-4127-b846-385c84c50ad6 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a88a8d7c9e4d0a88308c0e894570be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c31bb4f3ce486591bc142b1da7553e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:53:31.136367 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-e23b10ed-3a93-4127-b846-385c84c50ad6 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/170aa648-5004-4e0d-9f78-aad5b2764ce1" status: 200 len: 1362 microversion: 2.1 time: 0.242698 Apr 08 02:53:31.136903 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 384/764] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:53:30 2022] GET /compute/v2.1/servers/170aa648-5004-4e0d-9f78-aad5b2764ce1 => generated 1362 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:53:31.229102 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-42a3e3c9-424a-4634-9690-ff50a97cc2c5 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:31.229710 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-42a3e3c9-424a-4634-9690-ff50a97cc2c5 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] [instance: 2fb4b617-e0c5-4496-858f-f139414f8fb5] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:53:31.237076 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-42a3e3c9-424a-4634-9690-ff50a97cc2c5 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:31.237520 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-42a3e3c9-424a-4634-9690-ff50a97cc2c5 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:31.238280 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-42a3e3c9-424a-4634-9690-ff50a97cc2c5 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:31.238735 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-42a3e3c9-424a-4634-9690-ff50a97cc2c5 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:31.438790 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-42a3e3c9-424a-4634-9690-ff50a97cc2c5 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86a950d41cc44fb9f10b600b20b0ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f311117084470f8e8d16c47ad1d2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:53:31.446880 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-42a3e3c9-424a-4634-9690-ff50a97cc2c5 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] 10.222.0.48 "GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5" status: 200 len: 1569 microversion: 2.1 time: 0.228206 Apr 08 02:53:31.447414 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 381/765] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:53:31 2022] GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5 => generated 1569 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:53:32.158491 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-ca6320f8-7b4f-4172-a3fa-2f887bd972ea tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:32.159026 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-ca6320f8-7b4f-4172-a3fa-2f887bd972ea tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 170aa648-5004-4e0d-9f78-aad5b2764ce1] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:53:32.166942 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-ca6320f8-7b4f-4172-a3fa-2f887bd972ea tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:32.167386 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-ca6320f8-7b4f-4172-a3fa-2f887bd972ea tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:32.168147 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-ca6320f8-7b4f-4172-a3fa-2f887bd972ea tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:32.168576 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-ca6320f8-7b4f-4172-a3fa-2f887bd972ea tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:32.379782 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-ca6320f8-7b4f-4172-a3fa-2f887bd972ea tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a88a8d7c9e4d0a88308c0e894570be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c31bb4f3ce486591bc142b1da7553e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:53:32.388030 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-ca6320f8-7b4f-4172-a3fa-2f887bd972ea tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/170aa648-5004-4e0d-9f78-aad5b2764ce1" status: 200 len: 1362 microversion: 2.1 time: 0.238261 Apr 08 02:53:32.388626 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 385/766] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:53:32 2022] GET /compute/v2.1/servers/170aa648-5004-4e0d-9f78-aad5b2764ce1 => generated 1362 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:53:32.469741 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-afd07698-d246-4034-9582-e35e84c1eaa8 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:32.470334 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-afd07698-d246-4034-9582-e35e84c1eaa8 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] [instance: 2fb4b617-e0c5-4496-858f-f139414f8fb5] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:53:32.477555 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-afd07698-d246-4034-9582-e35e84c1eaa8 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:32.477994 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-afd07698-d246-4034-9582-e35e84c1eaa8 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:32.478773 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-afd07698-d246-4034-9582-e35e84c1eaa8 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:32.479196 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-afd07698-d246-4034-9582-e35e84c1eaa8 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:32.678694 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-afd07698-d246-4034-9582-e35e84c1eaa8 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86a950d41cc44fb9f10b600b20b0ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f311117084470f8e8d16c47ad1d2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:53:32.686592 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-afd07698-d246-4034-9582-e35e84c1eaa8 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] 10.222.0.48 "GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5" status: 200 len: 1569 microversion: 2.1 time: 0.225947 Apr 08 02:53:32.687144 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 382/767] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:53:32 2022] GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5 => generated 1569 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:53:33.410085 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-a52faf08-ac07-4a9c-829d-cf89b1197ad6 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:33.410728 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-a52faf08-ac07-4a9c-829d-cf89b1197ad6 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 170aa648-5004-4e0d-9f78-aad5b2764ce1] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:53:33.417964 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-a52faf08-ac07-4a9c-829d-cf89b1197ad6 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:33.418402 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-a52faf08-ac07-4a9c-829d-cf89b1197ad6 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:33.419191 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-a52faf08-ac07-4a9c-829d-cf89b1197ad6 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:33.419616 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-a52faf08-ac07-4a9c-829d-cf89b1197ad6 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:33.625880 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-a52faf08-ac07-4a9c-829d-cf89b1197ad6 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a88a8d7c9e4d0a88308c0e894570be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c31bb4f3ce486591bc142b1da7553e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:53:33.635123 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-a52faf08-ac07-4a9c-829d-cf89b1197ad6 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/170aa648-5004-4e0d-9f78-aad5b2764ce1" status: 200 len: 1549 microversion: 2.1 time: 0.233877 Apr 08 02:53:33.635665 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 386/768] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:53:33 2022] GET /compute/v2.1/servers/170aa648-5004-4e0d-9f78-aad5b2764ce1 => generated 1549 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:53:33.656681 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-2bbd369f-4a7b-44e8-91a1-79429ba09199 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:33.657278 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-2bbd369f-4a7b-44e8-91a1-79429ba09199 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 170aa648-5004-4e0d-9f78-aad5b2764ce1] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:53:33.664601 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-2bbd369f-4a7b-44e8-91a1-79429ba09199 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:33.664981 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-2bbd369f-4a7b-44e8-91a1-79429ba09199 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:33.665760 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-2bbd369f-4a7b-44e8-91a1-79429ba09199 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:33.666179 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-2bbd369f-4a7b-44e8-91a1-79429ba09199 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:33.763944 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-16f483fd-0749-41c2-8c9a-8cd79547e3cf tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:33.764590 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-16f483fd-0749-41c2-8c9a-8cd79547e3cf tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] [instance: 2fb4b617-e0c5-4496-858f-f139414f8fb5] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:53:33.773107 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-16f483fd-0749-41c2-8c9a-8cd79547e3cf tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:33.773545 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-16f483fd-0749-41c2-8c9a-8cd79547e3cf tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:33.774316 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-16f483fd-0749-41c2-8c9a-8cd79547e3cf tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:33.774785 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-16f483fd-0749-41c2-8c9a-8cd79547e3cf tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:33.830087 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-2bbd369f-4a7b-44e8-91a1-79429ba09199 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/170aa648-5004-4e0d-9f78-aad5b2764ce1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.182255 Apr 08 02:53:33.830859 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 383/769] 10.222.0.48 () {58 vars in 1274 bytes} [Fri Apr 8 02:53:33 2022] GET /compute/v2.1/servers/170aa648-5004-4e0d-9f78-aad5b2764ce1/os-interface => generated 285 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:53:34.016571 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-16f483fd-0749-41c2-8c9a-8cd79547e3cf tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86a950d41cc44fb9f10b600b20b0ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f311117084470f8e8d16c47ad1d2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:53:34.026200 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-16f483fd-0749-41c2-8c9a-8cd79547e3cf tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] 10.222.0.48 "GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5" status: 200 len: 1569 microversion: 2.1 time: 0.272248 Apr 08 02:53:34.027196 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 387/770] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:53:33 2022] GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5 => generated 1569 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:53:35.048950 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-7c2c4dfd-76f9-451e-82a0-978d8d0ace46 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:35.049546 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-7c2c4dfd-76f9-451e-82a0-978d8d0ace46 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] [instance: 2fb4b617-e0c5-4496-858f-f139414f8fb5] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:53:35.057680 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-7c2c4dfd-76f9-451e-82a0-978d8d0ace46 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:35.058124 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-7c2c4dfd-76f9-451e-82a0-978d8d0ace46 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:35.058924 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-7c2c4dfd-76f9-451e-82a0-978d8d0ace46 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:35.059353 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-7c2c4dfd-76f9-451e-82a0-978d8d0ace46 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:35.261013 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-7c2c4dfd-76f9-451e-82a0-978d8d0ace46 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86a950d41cc44fb9f10b600b20b0ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f311117084470f8e8d16c47ad1d2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:53:35.269446 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-7c2c4dfd-76f9-451e-82a0-978d8d0ace46 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] 10.222.0.48 "GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5" status: 200 len: 1569 microversion: 2.1 time: 0.229322 Apr 08 02:53:35.270152 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 384/771] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:53:35 2022] GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5 => generated 1569 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:53:35.446418 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [req-f6360498-afbb-4f6e-b5aa-14dcb361a2e5 req-50496cee-a86d-4f75-b409-b121f4056170 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "170aa648-5004-4e0d-9f78-aad5b2764ce1", "tag": "c589e3c6-07ca-44fc-ae31-96e15494023f"}]} {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:53:35.452609 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:53:35.452609 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: warnings.warn(msg) Apr 08 02:53:35.461151 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-f6360498-afbb-4f6e-b5aa-14dcb361a2e5 req-50496cee-a86d-4f75-b409-b121f4056170 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:35.461588 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-f6360498-afbb-4f6e-b5aa-14dcb361a2e5 req-50496cee-a86d-4f75-b409-b121f4056170 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:35.477136 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.compute.server_external_events [req-f6360498-afbb-4f6e-b5aa-14dcb361a2e5 req-50496cee-a86d-4f75-b409-b121f4056170 service nova] Creating event network-changed:c589e3c6-07ca-44fc-ae31-96e15494023f for instance 170aa648-5004-4e0d-9f78-aad5b2764ce1 on hv-cinder-83705 Apr 08 02:53:35.482030 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [req-f6360498-afbb-4f6e-b5aa-14dcb361a2e5 req-50496cee-a86d-4f75-b409-b121f4056170 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044822 Apr 08 02:53:35.482609 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 388/772] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:53:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:53:36.292468 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-ef468f19-c46d-4b83-abcc-3b481ebaa912 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:36.294802 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-ef468f19-c46d-4b83-abcc-3b481ebaa912 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] [instance: 2fb4b617-e0c5-4496-858f-f139414f8fb5] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:53:36.308282 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ef468f19-c46d-4b83-abcc-3b481ebaa912 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:36.309185 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ef468f19-c46d-4b83-abcc-3b481ebaa912 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:36.310210 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ef468f19-c46d-4b83-abcc-3b481ebaa912 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:36.311047 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ef468f19-c46d-4b83-abcc-3b481ebaa912 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:36.673641 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-ef468f19-c46d-4b83-abcc-3b481ebaa912 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86a950d41cc44fb9f10b600b20b0ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f311117084470f8e8d16c47ad1d2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:53:36.682866 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-ef468f19-c46d-4b83-abcc-3b481ebaa912 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] 10.222.0.48 "GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5" status: 200 len: 1569 microversion: 2.1 time: 0.399780 Apr 08 02:53:36.683405 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 385/773] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:53:36 2022] GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5 => generated 1569 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:53:37.706200 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-459918b7-33f6-4787-a79c-eb352afbdbd4 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:37.706979 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-459918b7-33f6-4787-a79c-eb352afbdbd4 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] [instance: 2fb4b617-e0c5-4496-858f-f139414f8fb5] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:53:37.714990 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-459918b7-33f6-4787-a79c-eb352afbdbd4 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:37.715428 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-459918b7-33f6-4787-a79c-eb352afbdbd4 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:37.716179 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-459918b7-33f6-4787-a79c-eb352afbdbd4 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:37.716602 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-459918b7-33f6-4787-a79c-eb352afbdbd4 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:37.932955 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-459918b7-33f6-4787-a79c-eb352afbdbd4 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86a950d41cc44fb9f10b600b20b0ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f311117084470f8e8d16c47ad1d2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:53:37.941149 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-459918b7-33f6-4787-a79c-eb352afbdbd4 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] 10.222.0.48 "GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5" status: 200 len: 1569 microversion: 2.1 time: 0.244519 Apr 08 02:53:37.941686 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 389/774] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:53:37 2022] GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5 => generated 1569 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:53:38.962554 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-22ed38f6-63a5-416d-b669-61ae81d46b2c tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:38.963248 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-22ed38f6-63a5-416d-b669-61ae81d46b2c tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] [instance: 2fb4b617-e0c5-4496-858f-f139414f8fb5] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:53:38.970387 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-22ed38f6-63a5-416d-b669-61ae81d46b2c tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:38.970878 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-22ed38f6-63a5-416d-b669-61ae81d46b2c tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:38.971644 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-22ed38f6-63a5-416d-b669-61ae81d46b2c tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:38.972080 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-22ed38f6-63a5-416d-b669-61ae81d46b2c tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:39.240580 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-22ed38f6-63a5-416d-b669-61ae81d46b2c tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86a950d41cc44fb9f10b600b20b0ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f311117084470f8e8d16c47ad1d2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:53:39.248742 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-22ed38f6-63a5-416d-b669-61ae81d46b2c tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] 10.222.0.48 "GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5" status: 200 len: 1569 microversion: 2.1 time: 0.295370 Apr 08 02:53:39.249271 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 386/775] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:53:38 2022] GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5 => generated 1569 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:53:40.270931 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-d0e2637e-34dd-4c84-8af0-baca115e0e4f tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:40.271569 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-d0e2637e-34dd-4c84-8af0-baca115e0e4f tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] [instance: 2fb4b617-e0c5-4496-858f-f139414f8fb5] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:53:40.278775 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-d0e2637e-34dd-4c84-8af0-baca115e0e4f tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:40.279218 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-d0e2637e-34dd-4c84-8af0-baca115e0e4f tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:40.279975 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-d0e2637e-34dd-4c84-8af0-baca115e0e4f tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:40.280404 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-d0e2637e-34dd-4c84-8af0-baca115e0e4f tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:40.481765 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-d0e2637e-34dd-4c84-8af0-baca115e0e4f tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86a950d41cc44fb9f10b600b20b0ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f311117084470f8e8d16c47ad1d2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:53:40.489906 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-d0e2637e-34dd-4c84-8af0-baca115e0e4f tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] 10.222.0.48 "GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5" status: 200 len: 1569 microversion: 2.1 time: 0.228200 Apr 08 02:53:40.491541 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 390/776] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:53:40 2022] GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5 => generated 1569 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:53:41.513097 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-5dd0cdd5-69bc-441f-92fc-b38dd5ade4a3 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:41.513683 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-5dd0cdd5-69bc-441f-92fc-b38dd5ade4a3 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] [instance: 2fb4b617-e0c5-4496-858f-f139414f8fb5] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:53:41.521343 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-5dd0cdd5-69bc-441f-92fc-b38dd5ade4a3 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:41.521781 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-5dd0cdd5-69bc-441f-92fc-b38dd5ade4a3 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:41.522545 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-5dd0cdd5-69bc-441f-92fc-b38dd5ade4a3 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:41.523009 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-5dd0cdd5-69bc-441f-92fc-b38dd5ade4a3 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:41.718134 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-5dd0cdd5-69bc-441f-92fc-b38dd5ade4a3 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86a950d41cc44fb9f10b600b20b0ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f311117084470f8e8d16c47ad1d2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:53:41.726091 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-5dd0cdd5-69bc-441f-92fc-b38dd5ade4a3 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] 10.222.0.48 "GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5" status: 200 len: 1510 microversion: 2.1 time: 0.222573 Apr 08 02:53:41.726617 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 387/777] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:53:41 2022] GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5 => generated 1510 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:53:41.748117 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-2142d30e-4ab2-42de-9927-2d5f57336659 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:53:41.748667 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-2142d30e-4ab2-42de-9927-2d5f57336659 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] [instance: 2fb4b617-e0c5-4496-858f-f139414f8fb5] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:53:41.755699 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-2142d30e-4ab2-42de-9927-2d5f57336659 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:41.756131 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-2142d30e-4ab2-42de-9927-2d5f57336659 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:41.756881 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-2142d30e-4ab2-42de-9927-2d5f57336659 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:41.757300 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-2142d30e-4ab2-42de-9927-2d5f57336659 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:41.984506 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-2142d30e-4ab2-42de-9927-2d5f57336659 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] 10.222.0.48 "POST /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5/action" status: 202 len: 0 microversion: 2.1 time: 0.245828 Apr 08 02:53:41.985171 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 391/778] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Apr 8 02:53:41 2022] POST /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5/action => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 02:53:41.998712 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-62d0c64a-b089-4e18-99cb-a116f52c3901 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:41.999321 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-62d0c64a-b089-4e18-99cb-a116f52c3901 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] [instance: 2fb4b617-e0c5-4496-858f-f139414f8fb5] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:53:42.006590 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-62d0c64a-b089-4e18-99cb-a116f52c3901 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:42.007082 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-62d0c64a-b089-4e18-99cb-a116f52c3901 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:42.008346 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-62d0c64a-b089-4e18-99cb-a116f52c3901 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:42.008789 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-62d0c64a-b089-4e18-99cb-a116f52c3901 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:42.219034 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-62d0c64a-b089-4e18-99cb-a116f52c3901 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86a950d41cc44fb9f10b600b20b0ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f311117084470f8e8d16c47ad1d2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:53:42.227701 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-62d0c64a-b089-4e18-99cb-a116f52c3901 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] 10.222.0.48 "GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5" status: 200 len: 1518 microversion: 2.1 time: 0.238358 Apr 08 02:53:42.228224 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 388/779] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:53:41 2022] GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5 => generated 1518 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:53:43.250734 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-3684731e-90ae-4d89-8508-3b61b3734fcc tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:43.251435 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-3684731e-90ae-4d89-8508-3b61b3734fcc tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] [instance: 2fb4b617-e0c5-4496-858f-f139414f8fb5] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:53:43.259196 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-3684731e-90ae-4d89-8508-3b61b3734fcc tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:43.259743 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-3684731e-90ae-4d89-8508-3b61b3734fcc tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:43.260642 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-3684731e-90ae-4d89-8508-3b61b3734fcc tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:43.261277 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-3684731e-90ae-4d89-8508-3b61b3734fcc tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:43.471373 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-3684731e-90ae-4d89-8508-3b61b3734fcc tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86a950d41cc44fb9f10b600b20b0ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f311117084470f8e8d16c47ad1d2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:53:43.480842 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-3684731e-90ae-4d89-8508-3b61b3734fcc tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] 10.222.0.48 "GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5" status: 200 len: 1520 microversion: 2.1 time: 0.239897 Apr 08 02:53:43.481471 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 392/780] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:53:43 2022] GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5 => generated 1520 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:53:44.503332 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-3bbe82c8-d01b-4904-9382-7e023900d61d tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:44.503933 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-3bbe82c8-d01b-4904-9382-7e023900d61d tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] [instance: 2fb4b617-e0c5-4496-858f-f139414f8fb5] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:53:44.511737 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-3bbe82c8-d01b-4904-9382-7e023900d61d tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:44.512178 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-3bbe82c8-d01b-4904-9382-7e023900d61d tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:44.513190 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-3bbe82c8-d01b-4904-9382-7e023900d61d tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:44.513611 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-3bbe82c8-d01b-4904-9382-7e023900d61d tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:44.619635 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [req-33a0ed14-6e57-4c07-9698-83ca4d4b4ae3 req-9a7aa981-fdfb-4d3e-b000-d76109be6234 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fb4b617-e0c5-4496-858f-f139414f8fb5", "name": "network-vif-unplugged", "status": "completed", "tag": "1be6ca01-4620-4592-8649-c93ad2064024"}]} {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:53:44.627555 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:53:44.627555 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: warnings.warn(msg) Apr 08 02:53:44.638414 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-33a0ed14-6e57-4c07-9698-83ca4d4b4ae3 req-9a7aa981-fdfb-4d3e-b000-d76109be6234 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:44.638877 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-33a0ed14-6e57-4c07-9698-83ca4d4b4ae3 req-9a7aa981-fdfb-4d3e-b000-d76109be6234 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:44.656713 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.compute.server_external_events [req-33a0ed14-6e57-4c07-9698-83ca4d4b4ae3 req-9a7aa981-fdfb-4d3e-b000-d76109be6234 service nova] Creating event network-vif-unplugged:1be6ca01-4620-4592-8649-c93ad2064024 for instance 2fb4b617-e0c5-4496-858f-f139414f8fb5 on hv-cinder-83705 Apr 08 02:53:44.661494 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [req-33a0ed14-6e57-4c07-9698-83ca4d4b4ae3 req-9a7aa981-fdfb-4d3e-b000-d76109be6234 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056504 Apr 08 02:53:44.662278 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 393/781] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:53:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 02:53:44.720102 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-3bbe82c8-d01b-4904-9382-7e023900d61d tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86a950d41cc44fb9f10b600b20b0ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f311117084470f8e8d16c47ad1d2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:53:44.728348 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-3bbe82c8-d01b-4904-9382-7e023900d61d tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] 10.222.0.48 "GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5" status: 200 len: 1576 microversion: 2.1 time: 0.233931 Apr 08 02:53:44.728869 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 389/782] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:53:44 2022] GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5 => generated 1576 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:53:45.751531 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-bb753f5e-408b-4e4f-8540-327f7d5630d8 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:45.752224 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-bb753f5e-408b-4e4f-8540-327f7d5630d8 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] [instance: 2fb4b617-e0c5-4496-858f-f139414f8fb5] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:53:45.759995 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-bb753f5e-408b-4e4f-8540-327f7d5630d8 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:45.760431 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-bb753f5e-408b-4e4f-8540-327f7d5630d8 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:45.761195 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-bb753f5e-408b-4e4f-8540-327f7d5630d8 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:45.761620 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-bb753f5e-408b-4e4f-8540-327f7d5630d8 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:45.966381 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-bb753f5e-408b-4e4f-8540-327f7d5630d8 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86a950d41cc44fb9f10b600b20b0ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f311117084470f8e8d16c47ad1d2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:53:45.974381 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-bb753f5e-408b-4e4f-8540-327f7d5630d8 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] 10.222.0.48 "GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5" status: 200 len: 1576 microversion: 2.1 time: 0.233288 Apr 08 02:53:45.974933 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 394/783] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:53:45 2022] GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5 => generated 1576 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:53:46.998067 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-4c4167fd-7515-47b3-8a4b-78f080771810 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:46.998681 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-4c4167fd-7515-47b3-8a4b-78f080771810 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] [instance: 2fb4b617-e0c5-4496-858f-f139414f8fb5] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:53:47.006034 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-4c4167fd-7515-47b3-8a4b-78f080771810 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:47.006486 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-4c4167fd-7515-47b3-8a4b-78f080771810 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:47.007297 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-4c4167fd-7515-47b3-8a4b-78f080771810 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:47.008002 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-4c4167fd-7515-47b3-8a4b-78f080771810 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:47.206708 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-4c4167fd-7515-47b3-8a4b-78f080771810 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86a950d41cc44fb9f10b600b20b0ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f311117084470f8e8d16c47ad1d2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:53:47.214927 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-4c4167fd-7515-47b3-8a4b-78f080771810 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] 10.222.0.48 "GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5" status: 200 len: 1576 microversion: 2.1 time: 0.226869 Apr 08 02:53:47.215463 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 390/784] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:53:46 2022] GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5 => generated 1576 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:53:48.237071 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-e55c91ba-c5db-47c3-ba56-40cf02948bc5 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:48.237582 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-e55c91ba-c5db-47c3-ba56-40cf02948bc5 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] [instance: 2fb4b617-e0c5-4496-858f-f139414f8fb5] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:53:48.245338 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-e55c91ba-c5db-47c3-ba56-40cf02948bc5 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:48.245768 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-e55c91ba-c5db-47c3-ba56-40cf02948bc5 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:48.246514 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-e55c91ba-c5db-47c3-ba56-40cf02948bc5 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:48.246969 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-e55c91ba-c5db-47c3-ba56-40cf02948bc5 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:48.447555 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-e55c91ba-c5db-47c3-ba56-40cf02948bc5 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86a950d41cc44fb9f10b600b20b0ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f311117084470f8e8d16c47ad1d2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:53:48.455482 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-e55c91ba-c5db-47c3-ba56-40cf02948bc5 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] 10.222.0.48 "GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5" status: 200 len: 1576 microversion: 2.1 time: 0.227397 Apr 08 02:53:48.456002 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 395/785] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:53:48 2022] GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5 => generated 1576 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:53:49.477677 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-cf5f4710-c658-4a89-91c0-be34d0abb006 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:49.478277 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-cf5f4710-c658-4a89-91c0-be34d0abb006 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] [instance: 2fb4b617-e0c5-4496-858f-f139414f8fb5] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:53:49.485400 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-cf5f4710-c658-4a89-91c0-be34d0abb006 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:49.485838 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-cf5f4710-c658-4a89-91c0-be34d0abb006 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:49.486591 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-cf5f4710-c658-4a89-91c0-be34d0abb006 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:49.487045 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-cf5f4710-c658-4a89-91c0-be34d0abb006 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:49.539213 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-149b1c05-82b3-4773-b256-578f82e5955a tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:49.539772 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-149b1c05-82b3-4773-b256-578f82e5955a tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 991d0926-dfa5-43b7-a6d4-b745f1bb8e59] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:53:49.546728 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-149b1c05-82b3-4773-b256-578f82e5955a tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:49.547172 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-149b1c05-82b3-4773-b256-578f82e5955a tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:49.547938 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-149b1c05-82b3-4773-b256-578f82e5955a tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:49.548358 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-149b1c05-82b3-4773-b256-578f82e5955a tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:49.610367 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-149b1c05-82b3-4773-b256-578f82e5955a tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/991d0926-dfa5-43b7-a6d4-b745f1bb8e59/ips" status: 200 len: 149 microversion: 2.1 time: 0.080687 Apr 08 02:53:49.610948 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 396/786] 10.222.0.48 () {58 vars in 1247 bytes} [Fri Apr 8 02:53:49 2022] GET /compute/v2.1/servers/991d0926-dfa5-43b7-a6d4-b745f1bb8e59/ips => generated 149 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 02:53:49.692308 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-cf5f4710-c658-4a89-91c0-be34d0abb006 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86a950d41cc44fb9f10b600b20b0ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f311117084470f8e8d16c47ad1d2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:53:49.701222 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-cf5f4710-c658-4a89-91c0-be34d0abb006 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] 10.222.0.48 "GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5" status: 200 len: 1576 microversion: 2.1 time: 0.232704 Apr 08 02:53:49.701754 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 391/787] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:53:49 2022] GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5 => generated 1576 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:53:50.709994 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-59534400-2eed-474a-83cd-3319bdfa51a2 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:50.710735 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-59534400-2eed-474a-83cd-3319bdfa51a2 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: bbeb7a47-a8ee-44b3-bc79-bd12670aaa33] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:53:50.718178 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-59534400-2eed-474a-83cd-3319bdfa51a2 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:50.718614 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-59534400-2eed-474a-83cd-3319bdfa51a2 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:50.719403 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-59534400-2eed-474a-83cd-3319bdfa51a2 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:50.719828 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-59534400-2eed-474a-83cd-3319bdfa51a2 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:50.723178 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-42466632-ea42-416b-b46f-6d3947ae7cd6 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:50.723775 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-42466632-ea42-416b-b46f-6d3947ae7cd6 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] [instance: 2fb4b617-e0c5-4496-858f-f139414f8fb5] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:53:50.731457 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-42466632-ea42-416b-b46f-6d3947ae7cd6 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:50.731961 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-42466632-ea42-416b-b46f-6d3947ae7cd6 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:50.732750 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-42466632-ea42-416b-b46f-6d3947ae7cd6 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:50.733171 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-42466632-ea42-416b-b46f-6d3947ae7cd6 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:50.780596 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-59534400-2eed-474a-83cd-3319bdfa51a2 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33/ips" status: 200 len: 152 microversion: 2.20 time: 0.079721 Apr 08 02:53:50.781160 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 397/788] 10.222.0.48 () {60 vars in 1288 bytes} [Fri Apr 8 02:53:50 2022] GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33/ips => generated 152 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 02:53:50.928856 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-42466632-ea42-416b-b46f-6d3947ae7cd6 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86a950d41cc44fb9f10b600b20b0ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f311117084470f8e8d16c47ad1d2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:53:50.937599 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-42466632-ea42-416b-b46f-6d3947ae7cd6 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] 10.222.0.48 "GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5" status: 200 len: 1576 microversion: 2.1 time: 0.223241 Apr 08 02:53:50.938134 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 392/789] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:53:50 2022] GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5 => generated 1576 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:53:51.066423 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-1253dfd8-0f17-4ea4-a4cb-48c02c5c54b0 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fd31ff39-05f9-48e8-a97b-1f364e3db41b"}} {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:53:51.067515 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-1253dfd8-0f17-4ea4-a4cb-48c02c5c54b0 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 991d0926-dfa5-43b7-a6d4-b745f1bb8e59] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:53:51.075047 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-1253dfd8-0f17-4ea4-a4cb-48c02c5c54b0 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:51.075484 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-1253dfd8-0f17-4ea4-a4cb-48c02c5c54b0 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:51.076335 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-1253dfd8-0f17-4ea4-a4cb-48c02c5c54b0 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:51.076744 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-1253dfd8-0f17-4ea4-a4cb-48c02c5c54b0 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:51.437768 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-1253dfd8-0f17-4ea4-a4cb-48c02c5c54b0 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "POST /compute/v2.1/servers/991d0926-dfa5-43b7-a6d4-b745f1bb8e59/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.381688 Apr 08 02:53:51.438365 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 398/790] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Apr 8 02:53:51 2022] POST /compute/v2.1/servers/991d0926-dfa5-43b7-a6d4-b745f1bb8e59/os-volume_attachments => generated 194 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:53:51.960963 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-aeecfca3-8eba-4162-b678-6819415125d6 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:51.962470 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-aeecfca3-8eba-4162-b678-6819415125d6 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] [instance: 2fb4b617-e0c5-4496-858f-f139414f8fb5] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:53:51.969122 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-aeecfca3-8eba-4162-b678-6819415125d6 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:51.969676 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-aeecfca3-8eba-4162-b678-6819415125d6 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:51.970503 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-aeecfca3-8eba-4162-b678-6819415125d6 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:51.971036 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-aeecfca3-8eba-4162-b678-6819415125d6 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:52.177945 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-aeecfca3-8eba-4162-b678-6819415125d6 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86a950d41cc44fb9f10b600b20b0ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f311117084470f8e8d16c47ad1d2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:53:52.186507 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-aeecfca3-8eba-4162-b678-6819415125d6 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] 10.222.0.48 "GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5" status: 200 len: 1576 microversion: 2.1 time: 0.235039 Apr 08 02:53:52.187106 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 393/791] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:53:51 2022] GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5 => generated 1576 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:53:53.210410 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-cc6f4b8b-f4e7-4527-9de8-8b4ab5a6bbcb tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:53.211121 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-cc6f4b8b-f4e7-4527-9de8-8b4ab5a6bbcb tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] [instance: 2fb4b617-e0c5-4496-858f-f139414f8fb5] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:53:53.219262 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-cc6f4b8b-f4e7-4527-9de8-8b4ab5a6bbcb tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:53.219703 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-cc6f4b8b-f4e7-4527-9de8-8b4ab5a6bbcb tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:53.220463 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-cc6f4b8b-f4e7-4527-9de8-8b4ab5a6bbcb tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:53.220890 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-cc6f4b8b-f4e7-4527-9de8-8b4ab5a6bbcb tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:53.425017 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-cc6f4b8b-f4e7-4527-9de8-8b4ab5a6bbcb tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86a950d41cc44fb9f10b600b20b0ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f311117084470f8e8d16c47ad1d2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:53:53.433133 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-cc6f4b8b-f4e7-4527-9de8-8b4ab5a6bbcb tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] 10.222.0.48 "GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5" status: 200 len: 1576 microversion: 2.1 time: 0.232577 Apr 08 02:53:53.433668 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 399/792] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:53:53 2022] GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5 => generated 1576 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:53:53.441736 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-bfeb83b1-d5dc-4ad4-b177-748db1c07652 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:53:53.442266 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-bfeb83b1-d5dc-4ad4-b177-748db1c07652 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: bbeb7a47-a8ee-44b3-bc79-bd12670aaa33] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:53:53.449502 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-bfeb83b1-d5dc-4ad4-b177-748db1c07652 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:53.449944 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-bfeb83b1-d5dc-4ad4-b177-748db1c07652 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:53.450731 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-bfeb83b1-d5dc-4ad4-b177-748db1c07652 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:53.451165 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-bfeb83b1-d5dc-4ad4-b177-748db1c07652 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:53.516047 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.objects.instance [None req-bfeb83b1-d5dc-4ad4-b177-748db1c07652 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lazy-loading 'flavor' on Instance uuid bbeb7a47-a8ee-44b3-bc79-bd12670aaa33 {{(pid=96919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 08 02:53:53.839553 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-bfeb83b1-d5dc-4ad4-b177-748db1c07652 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "POST /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33/action" status: 202 len: 0 microversion: 2.20 time: 0.406578 Apr 08 02:53:53.840173 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 394/793] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Apr 8 02:53:53 2022] POST /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33/action => generated 0 bytes in 408 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Apr 08 02:53:53.853914 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-9cc88e9d-4f5c-4069-b5c7-b837142f2629 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:53.854524 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-9cc88e9d-4f5c-4069-b5c7-b837142f2629 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: bbeb7a47-a8ee-44b3-bc79-bd12670aaa33] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:53:53.861826 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-9cc88e9d-4f5c-4069-b5c7-b837142f2629 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:53.862272 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-9cc88e9d-4f5c-4069-b5c7-b837142f2629 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:53.863068 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-9cc88e9d-4f5c-4069-b5c7-b837142f2629 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:53.863498 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-9cc88e9d-4f5c-4069-b5c7-b837142f2629 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:54.062460 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-9cc88e9d-4f5c-4069-b5c7-b837142f2629 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:53:54.076434 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-9cc88e9d-4f5c-4069-b5c7-b837142f2629 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:53:54.082510 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-9cc88e9d-4f5c-4069-b5c7-b837142f2629 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:53:54.083673 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-9cc88e9d-4f5c-4069-b5c7-b837142f2629 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33" status: 200 len: 1724 microversion: 2.20 time: 0.239304 Apr 08 02:53:54.084189 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 400/794] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:53:53 2022] GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33 => generated 1724 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:53:54.455193 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-24a2f24e-eb77-4f11-8402-839737d0f254 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:54.456836 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-24a2f24e-eb77-4f11-8402-839737d0f254 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] [instance: 2fb4b617-e0c5-4496-858f-f139414f8fb5] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:53:54.464652 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-24a2f24e-eb77-4f11-8402-839737d0f254 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:54.465093 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-24a2f24e-eb77-4f11-8402-839737d0f254 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:54.465873 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-24a2f24e-eb77-4f11-8402-839737d0f254 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:54.466312 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-24a2f24e-eb77-4f11-8402-839737d0f254 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:54.667968 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-24a2f24e-eb77-4f11-8402-839737d0f254 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86a950d41cc44fb9f10b600b20b0ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f311117084470f8e8d16c47ad1d2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:53:54.676075 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-24a2f24e-eb77-4f11-8402-839737d0f254 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] 10.222.0.48 "GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5" status: 200 len: 1563 microversion: 2.1 time: 0.230600 Apr 08 02:53:54.676608 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 395/795] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:53:54 2022] GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5 => generated 1563 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:53:55.107244 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-fc10e897-cae0-42f4-a07b-d47c71f978f9 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:55.107830 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-fc10e897-cae0-42f4-a07b-d47c71f978f9 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: bbeb7a47-a8ee-44b3-bc79-bd12670aaa33] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:53:55.114983 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-fc10e897-cae0-42f4-a07b-d47c71f978f9 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:55.115430 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-fc10e897-cae0-42f4-a07b-d47c71f978f9 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:55.116182 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-fc10e897-cae0-42f4-a07b-d47c71f978f9 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:55.116610 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-fc10e897-cae0-42f4-a07b-d47c71f978f9 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:55.316795 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-fc10e897-cae0-42f4-a07b-d47c71f978f9 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:53:55.330602 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-fc10e897-cae0-42f4-a07b-d47c71f978f9 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:53:55.337200 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-fc10e897-cae0-42f4-a07b-d47c71f978f9 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:53:55.338368 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-fc10e897-cae0-42f4-a07b-d47c71f978f9 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33" status: 200 len: 1724 microversion: 2.20 time: 0.240728 Apr 08 02:53:55.338961 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 401/796] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:53:55 2022] GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33 => generated 1724 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:53:56.362952 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-da2af9be-f195-4ded-a474-9ee97a25cc53 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:56.363565 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-da2af9be-f195-4ded-a474-9ee97a25cc53 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: bbeb7a47-a8ee-44b3-bc79-bd12670aaa33] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:53:56.371013 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-da2af9be-f195-4ded-a474-9ee97a25cc53 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:56.371453 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-da2af9be-f195-4ded-a474-9ee97a25cc53 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:56.372210 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-da2af9be-f195-4ded-a474-9ee97a25cc53 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:56.372640 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-da2af9be-f195-4ded-a474-9ee97a25cc53 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:56.582754 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-da2af9be-f195-4ded-a474-9ee97a25cc53 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:53:56.596880 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-da2af9be-f195-4ded-a474-9ee97a25cc53 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:53:56.603204 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-da2af9be-f195-4ded-a474-9ee97a25cc53 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:53:56.604343 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-da2af9be-f195-4ded-a474-9ee97a25cc53 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33" status: 200 len: 1724 microversion: 2.20 time: 0.250414 Apr 08 02:53:56.604875 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 396/797] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:53:56 2022] GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33 => generated 1724 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:53:56.772875 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [req-34568f9d-a921-44bb-a322-16bbc337390f req-6b66d3fc-574b-4625-b826-1ae4efe53dc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fb4b617-e0c5-4496-858f-f139414f8fb5", "name": "network-vif-plugged", "status": "completed", "tag": "1be6ca01-4620-4592-8649-c93ad2064024"}]} {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:53:56.780574 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:53:56.780574 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: warnings.warn(msg) Apr 08 02:53:56.790744 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-34568f9d-a921-44bb-a322-16bbc337390f req-6b66d3fc-574b-4625-b826-1ae4efe53dc2 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:56.791228 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-34568f9d-a921-44bb-a322-16bbc337390f req-6b66d3fc-574b-4625-b826-1ae4efe53dc2 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:56.807179 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.compute.server_external_events [req-34568f9d-a921-44bb-a322-16bbc337390f req-6b66d3fc-574b-4625-b826-1ae4efe53dc2 service nova] Creating event network-vif-plugged:1be6ca01-4620-4592-8649-c93ad2064024 for instance 2fb4b617-e0c5-4496-858f-f139414f8fb5 on hv-cinder-83705 Apr 08 02:53:56.812519 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [req-34568f9d-a921-44bb-a322-16bbc337390f req-6b66d3fc-574b-4625-b826-1ae4efe53dc2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048699 Apr 08 02:53:56.813105 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 402/798] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:53:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:53:57.627663 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-4bde47a1-bd23-47a7-a701-afcc3d73a065 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:57.628259 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-4bde47a1-bd23-47a7-a701-afcc3d73a065 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: bbeb7a47-a8ee-44b3-bc79-bd12670aaa33] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:53:57.635959 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-4bde47a1-bd23-47a7-a701-afcc3d73a065 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:57.636406 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-4bde47a1-bd23-47a7-a701-afcc3d73a065 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:57.637168 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-4bde47a1-bd23-47a7-a701-afcc3d73a065 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:57.637853 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-4bde47a1-bd23-47a7-a701-afcc3d73a065 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:57.833316 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-4bde47a1-bd23-47a7-a701-afcc3d73a065 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:53:57.846399 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-4bde47a1-bd23-47a7-a701-afcc3d73a065 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:53:57.852512 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-4bde47a1-bd23-47a7-a701-afcc3d73a065 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:53:57.853597 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-4bde47a1-bd23-47a7-a701-afcc3d73a065 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33" status: 200 len: 1724 microversion: 2.20 time: 0.234985 Apr 08 02:53:57.854118 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 397/799] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:53:57 2022] GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33 => generated 1724 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:53:58.877194 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-913bb8b2-2fae-4231-b3d9-0181626b4e0d tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:58.877872 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-913bb8b2-2fae-4231-b3d9-0181626b4e0d tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: bbeb7a47-a8ee-44b3-bc79-bd12670aaa33] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:53:58.886007 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-913bb8b2-2fae-4231-b3d9-0181626b4e0d tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:58.886467 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-913bb8b2-2fae-4231-b3d9-0181626b4e0d tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:58.887236 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-913bb8b2-2fae-4231-b3d9-0181626b4e0d tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:58.887932 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-913bb8b2-2fae-4231-b3d9-0181626b4e0d tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:59.163941 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-913bb8b2-2fae-4231-b3d9-0181626b4e0d tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:53:59.177132 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-913bb8b2-2fae-4231-b3d9-0181626b4e0d tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:53:59.183475 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-913bb8b2-2fae-4231-b3d9-0181626b4e0d tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:53:59.184583 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-913bb8b2-2fae-4231-b3d9-0181626b4e0d tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33" status: 200 len: 1724 microversion: 2.20 time: 0.316869 Apr 08 02:53:59.185099 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 403/800] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:53:58 2022] GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33 => generated 1724 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:53:59.200798 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-730e5288-5026-4043-aa21-f9ed7f0165be tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fd31ff39-05f9-48e8-a97b-1f364e3db41b"}} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:53:59.201902 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-730e5288-5026-4043-aa21-f9ed7f0165be tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 991d0926-dfa5-43b7-a6d4-b745f1bb8e59] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:53:59.209063 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-730e5288-5026-4043-aa21-f9ed7f0165be tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:59.209499 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-730e5288-5026-4043-aa21-f9ed7f0165be tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:59.210252 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-730e5288-5026-4043-aa21-f9ed7f0165be tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:59.211301 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-730e5288-5026-4043-aa21-f9ed7f0165be tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:59.277230 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.wsgi [None req-730e5288-5026-4043-aa21-f9ed7f0165be tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] HTTP exception thrown: Invalid volume: volume fd31ff39-05f9-48e8-a97b-1f364e3db41b already attached Apr 08 02:53:59.277804 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-730e5288-5026-4043-aa21-f9ed7f0165be tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Returning 400 to user: Invalid volume: volume fd31ff39-05f9-48e8-a97b-1f364e3db41b already attached {{(pid=96919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Apr 08 02:53:59.278605 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-730e5288-5026-4043-aa21-f9ed7f0165be tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "POST /compute/v2.1/servers/991d0926-dfa5-43b7-a6d4-b745f1bb8e59/os-volume_attachments" status: 400 len: 120 microversion: 2.1 time: 0.087388 Apr 08 02:53:59.279167 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 398/801] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Apr 8 02:53:59 2022] POST /compute/v2.1/servers/991d0926-dfa5-43b7-a6d4-b745f1bb8e59/os-volume_attachments => generated 120 bytes in 88 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 08 02:53:59.372897 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-96f97946-663d-434d-8f81-301d64925531 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:59.373384 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-96f97946-663d-434d-8f81-301d64925531 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 991d0926-dfa5-43b7-a6d4-b745f1bb8e59] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:53:59.381577 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-96f97946-663d-434d-8f81-301d64925531 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:59.382019 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-96f97946-663d-434d-8f81-301d64925531 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:59.383583 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-96f97946-663d-434d-8f81-301d64925531 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:59.384011 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-96f97946-663d-434d-8f81-301d64925531 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:59.622094 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-96f97946-663d-434d-8f81-301d64925531 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "DELETE /compute/v2.1/servers/991d0926-dfa5-43b7-a6d4-b745f1bb8e59/os-volume_attachments/fd31ff39-05f9-48e8-a97b-1f364e3db41b" status: 202 len: 0 microversion: 2.1 time: 0.258592 Apr 08 02:53:59.623121 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 404/802] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Apr 8 02:53:59 2022] DELETE /compute/v2.1/servers/991d0926-dfa5-43b7-a6d4-b745f1bb8e59/os-volume_attachments/fd31ff39-05f9-48e8-a97b-1f364e3db41b => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 02:53:59.637810 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-9a2b5f03-ce7b-46a6-9761-d524b1443d46 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:53:59.638903 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-9a2b5f03-ce7b-46a6-9761-d524b1443d46 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 991d0926-dfa5-43b7-a6d4-b745f1bb8e59] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:53:59.646360 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-9a2b5f03-ce7b-46a6-9761-d524b1443d46 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:59.646839 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-9a2b5f03-ce7b-46a6-9761-d524b1443d46 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:59.647609 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-9a2b5f03-ce7b-46a6-9761-d524b1443d46 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:53:59.648038 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-9a2b5f03-ce7b-46a6-9761-d524b1443d46 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:53:59.720720 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-9a2b5f03-ce7b-46a6-9761-d524b1443d46 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/991d0926-dfa5-43b7-a6d4-b745f1bb8e59/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093060 Apr 08 02:53:59.721190 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 399/803] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Apr 8 02:53:59 2022] GET /compute/v2.1/servers/991d0926-dfa5-43b7-a6d4-b745f1bb8e59/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:54:00.207992 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-71d15029-b552-4751-a129-75e69dc74669 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:00.208673 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-71d15029-b552-4751-a129-75e69dc74669 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: bbeb7a47-a8ee-44b3-bc79-bd12670aaa33] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:00.216883 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-71d15029-b552-4751-a129-75e69dc74669 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:00.217323 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-71d15029-b552-4751-a129-75e69dc74669 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:00.218084 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-71d15029-b552-4751-a129-75e69dc74669 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:00.218510 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-71d15029-b552-4751-a129-75e69dc74669 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:00.427580 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-71d15029-b552-4751-a129-75e69dc74669 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:00.441091 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-71d15029-b552-4751-a129-75e69dc74669 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:00.448098 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-71d15029-b552-4751-a129-75e69dc74669 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:00.449191 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-71d15029-b552-4751-a129-75e69dc74669 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33" status: 200 len: 1724 microversion: 2.20 time: 0.250615 Apr 08 02:54:00.449718 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 405/804] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:54:00 2022] GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33 => generated 1724 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:54:00.737229 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-ed8b84e0-b84f-4994-9d09-02d0f940e87f tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:00.738142 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-ed8b84e0-b84f-4994-9d09-02d0f940e87f tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 991d0926-dfa5-43b7-a6d4-b745f1bb8e59] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:00.745861 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ed8b84e0-b84f-4994-9d09-02d0f940e87f tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:00.746304 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ed8b84e0-b84f-4994-9d09-02d0f940e87f tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:00.747100 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ed8b84e0-b84f-4994-9d09-02d0f940e87f tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:00.747533 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ed8b84e0-b84f-4994-9d09-02d0f940e87f tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:00.814240 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-ed8b84e0-b84f-4994-9d09-02d0f940e87f tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/991d0926-dfa5-43b7-a6d4-b745f1bb8e59/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.086106 Apr 08 02:54:00.814803 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 400/805] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Apr 8 02:54:00 2022] GET /compute/v2.1/servers/991d0926-dfa5-43b7-a6d4-b745f1bb8e59/os-volume_attachments => generated 25 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 08 02:54:00.908902 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-95bf7ea8-0ce3-417f-a100-b67693dda4dd tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:00.909386 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-95bf7ea8-0ce3-417f-a100-b67693dda4dd tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 991d0926-dfa5-43b7-a6d4-b745f1bb8e59] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:00.916584 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-95bf7ea8-0ce3-417f-a100-b67693dda4dd tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:00.917021 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-95bf7ea8-0ce3-417f-a100-b67693dda4dd tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:00.917775 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-95bf7ea8-0ce3-417f-a100-b67693dda4dd tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:00.918192 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-95bf7ea8-0ce3-417f-a100-b67693dda4dd tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:00.982564 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-95bf7ea8-0ce3-417f-a100-b67693dda4dd tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 991d0926-dfa5-43b7-a6d4-b745f1bb8e59] Going to try to terminate instance {{(pid=96920) delete /opt/stack/nova/nova/compute/api.py:2559}} Apr 08 02:54:01.095546 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-95bf7ea8-0ce3-417f-a100-b67693dda4dd tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "DELETE /compute/v2.1/servers/991d0926-dfa5-43b7-a6d4-b745f1bb8e59" status: 204 len: 0 microversion: 2.1 time: 0.195132 Apr 08 02:54:01.096161 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 406/806] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Apr 8 02:54:00 2022] DELETE /compute/v2.1/servers/991d0926-dfa5-43b7-a6d4-b745f1bb8e59 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 08 02:54:01.109551 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-db607073-ea20-43ee-9ea3-926cb820a26b tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:01.110152 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-db607073-ea20-43ee-9ea3-926cb820a26b tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 991d0926-dfa5-43b7-a6d4-b745f1bb8e59] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:01.117873 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-db607073-ea20-43ee-9ea3-926cb820a26b tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:01.118312 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-db607073-ea20-43ee-9ea3-926cb820a26b tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:01.119120 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-db607073-ea20-43ee-9ea3-926cb820a26b tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:01.119555 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-db607073-ea20-43ee-9ea3-926cb820a26b tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:01.317456 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-db607073-ea20-43ee-9ea3-926cb820a26b tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68bc45984974d6da1c9151c21dae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbf5bb7e51d4d2d8594d6d1d3a797a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:01.326992 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-db607073-ea20-43ee-9ea3-926cb820a26b tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/991d0926-dfa5-43b7-a6d4-b745f1bb8e59" status: 200 len: 1680 microversion: 2.1 time: 0.226249 Apr 08 02:54:01.327549 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 401/807] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:54:01 2022] GET /compute/v2.1/servers/991d0926-dfa5-43b7-a6d4-b745f1bb8e59 => generated 1680 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:54:01.473216 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-b9c95752-838d-4c78-8dd4-b5507845db03 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:01.473836 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-b9c95752-838d-4c78-8dd4-b5507845db03 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: bbeb7a47-a8ee-44b3-bc79-bd12670aaa33] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:01.481676 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b9c95752-838d-4c78-8dd4-b5507845db03 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:01.482117 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b9c95752-838d-4c78-8dd4-b5507845db03 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:01.482914 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b9c95752-838d-4c78-8dd4-b5507845db03 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:01.483343 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b9c95752-838d-4c78-8dd4-b5507845db03 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:01.702887 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-b9c95752-838d-4c78-8dd4-b5507845db03 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:01.716320 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-b9c95752-838d-4c78-8dd4-b5507845db03 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:01.722321 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-b9c95752-838d-4c78-8dd4-b5507845db03 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:01.723420 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-b9c95752-838d-4c78-8dd4-b5507845db03 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33" status: 200 len: 1724 microversion: 2.20 time: 0.259739 Apr 08 02:54:01.723940 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 407/808] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:54:01 2022] GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33 => generated 1724 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:54:02.348816 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-f70d6b90-7355-4532-b36f-abc349bc50bd tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:02.349433 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-f70d6b90-7355-4532-b36f-abc349bc50bd tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 991d0926-dfa5-43b7-a6d4-b745f1bb8e59] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:02.357770 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-f70d6b90-7355-4532-b36f-abc349bc50bd tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:02.358215 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-f70d6b90-7355-4532-b36f-abc349bc50bd tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:02.359011 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-f70d6b90-7355-4532-b36f-abc349bc50bd tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:02.359444 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-f70d6b90-7355-4532-b36f-abc349bc50bd tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:02.563605 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-f70d6b90-7355-4532-b36f-abc349bc50bd tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68bc45984974d6da1c9151c21dae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbf5bb7e51d4d2d8594d6d1d3a797a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:02.571836 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-f70d6b90-7355-4532-b36f-abc349bc50bd tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/991d0926-dfa5-43b7-a6d4-b745f1bb8e59" status: 200 len: 1680 microversion: 2.1 time: 0.232047 Apr 08 02:54:02.572373 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 402/809] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:54:02 2022] GET /compute/v2.1/servers/991d0926-dfa5-43b7-a6d4-b745f1bb8e59 => generated 1680 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:54:02.746706 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-c9fa47c6-d227-4249-8244-8e2ba810837c tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:02.747269 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-c9fa47c6-d227-4249-8244-8e2ba810837c tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: bbeb7a47-a8ee-44b3-bc79-bd12670aaa33] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:02.754317 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c9fa47c6-d227-4249-8244-8e2ba810837c tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:02.754791 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c9fa47c6-d227-4249-8244-8e2ba810837c tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:02.755553 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c9fa47c6-d227-4249-8244-8e2ba810837c tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:02.755979 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c9fa47c6-d227-4249-8244-8e2ba810837c tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:02.958254 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-c9fa47c6-d227-4249-8244-8e2ba810837c tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:02.971694 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-c9fa47c6-d227-4249-8244-8e2ba810837c tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:02.978382 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-c9fa47c6-d227-4249-8244-8e2ba810837c tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:02.979515 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-c9fa47c6-d227-4249-8244-8e2ba810837c tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33" status: 200 len: 1724 microversion: 2.20 time: 0.241834 Apr 08 02:54:02.980229 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 408/810] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:54:02 2022] GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33 => generated 1724 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:54:03.594466 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-4c7ce4e0-d8c3-4f91-b567-a27bd8b6b92b tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:03.595106 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-4c7ce4e0-d8c3-4f91-b567-a27bd8b6b92b tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 991d0926-dfa5-43b7-a6d4-b745f1bb8e59] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:03.602328 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-4c7ce4e0-d8c3-4f91-b567-a27bd8b6b92b tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:03.602741 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-4c7ce4e0-d8c3-4f91-b567-a27bd8b6b92b tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:03.603504 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-4c7ce4e0-d8c3-4f91-b567-a27bd8b6b92b tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:03.603930 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-4c7ce4e0-d8c3-4f91-b567-a27bd8b6b92b tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:03.813068 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-4c7ce4e0-d8c3-4f91-b567-a27bd8b6b92b tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68bc45984974d6da1c9151c21dae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbf5bb7e51d4d2d8594d6d1d3a797a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:03.821553 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-4c7ce4e0-d8c3-4f91-b567-a27bd8b6b92b tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/991d0926-dfa5-43b7-a6d4-b745f1bb8e59" status: 200 len: 1680 microversion: 2.1 time: 0.236831 Apr 08 02:54:03.822099 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 403/811] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:54:03 2022] GET /compute/v2.1/servers/991d0926-dfa5-43b7-a6d4-b745f1bb8e59 => generated 1680 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:54:04.002979 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-74c8abbc-0ba7-48dc-a284-1a7199a495ee tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:04.003740 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-74c8abbc-0ba7-48dc-a284-1a7199a495ee tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: bbeb7a47-a8ee-44b3-bc79-bd12670aaa33] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:04.011297 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-74c8abbc-0ba7-48dc-a284-1a7199a495ee tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:04.011742 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-74c8abbc-0ba7-48dc-a284-1a7199a495ee tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:04.012775 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-74c8abbc-0ba7-48dc-a284-1a7199a495ee tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:04.013405 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-74c8abbc-0ba7-48dc-a284-1a7199a495ee tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:04.225319 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-74c8abbc-0ba7-48dc-a284-1a7199a495ee tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:04.241212 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-74c8abbc-0ba7-48dc-a284-1a7199a495ee tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:04.250948 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-74c8abbc-0ba7-48dc-a284-1a7199a495ee tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:04.252581 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-74c8abbc-0ba7-48dc-a284-1a7199a495ee tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33" status: 200 len: 1724 microversion: 2.20 time: 0.259123 Apr 08 02:54:04.253658 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 409/812] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:54:03 2022] GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33 => generated 1724 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:54:04.340889 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [req-061c4349-20c4-4666-b019-c24a6ec38f33 req-564104d5-ea65-4878-8003-a9265d3f36f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "991d0926-dfa5-43b7-a6d4-b745f1bb8e59", "name": "network-vif-deleted", "tag": "91c08498-dc67-4de7-be78-2f9d88554354"}]} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:54:04.347835 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:54:04.347835 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: warnings.warn(msg) Apr 08 02:54:04.356673 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-061c4349-20c4-4666-b019-c24a6ec38f33 req-564104d5-ea65-4878-8003-a9265d3f36f0 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:04.357114 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-061c4349-20c4-4666-b019-c24a6ec38f33 req-564104d5-ea65-4878-8003-a9265d3f36f0 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:04.374263 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.compute.server_external_events [req-061c4349-20c4-4666-b019-c24a6ec38f33 req-564104d5-ea65-4878-8003-a9265d3f36f0 service nova] Creating event network-vif-deleted:91c08498-dc67-4de7-be78-2f9d88554354 for instance 991d0926-dfa5-43b7-a6d4-b745f1bb8e59 on hv-cinder-83705 Apr 08 02:54:04.379232 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [req-061c4349-20c4-4666-b019-c24a6ec38f33 req-564104d5-ea65-4878-8003-a9265d3f36f0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051221 Apr 08 02:54:04.380810 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 404/813] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:54:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:54:04.844809 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-17671f83-0657-48d9-9476-b4afb2ccab1e tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:04.845496 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-17671f83-0657-48d9-9476-b4afb2ccab1e tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 991d0926-dfa5-43b7-a6d4-b745f1bb8e59] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:04.853750 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-17671f83-0657-48d9-9476-b4afb2ccab1e tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:04.854186 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-17671f83-0657-48d9-9476-b4afb2ccab1e tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:04.855115 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-17671f83-0657-48d9-9476-b4afb2ccab1e tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:04.855607 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-17671f83-0657-48d9-9476-b4afb2ccab1e tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:04.936972 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-17671f83-0657-48d9-9476-b4afb2ccab1e tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:04.937418 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-17671f83-0657-48d9-9476-b4afb2ccab1e tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:04.937863 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.objects.instance [None req-17671f83-0657-48d9-9476-b4afb2ccab1e tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lazy-loading 'fault' on Instance uuid 991d0926-dfa5-43b7-a6d4-b745f1bb8e59 {{(pid=96920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 08 02:54:05.012290 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-17671f83-0657-48d9-9476-b4afb2ccab1e tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68bc45984974d6da1c9151c21dae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbf5bb7e51d4d2d8594d6d1d3a797a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:05.020265 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-17671f83-0657-48d9-9476-b4afb2ccab1e tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/991d0926-dfa5-43b7-a6d4-b745f1bb8e59" status: 200 len: 1331 microversion: 2.1 time: 0.185148 Apr 08 02:54:05.020835 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 410/814] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:54:04 2022] GET /compute/v2.1/servers/991d0926-dfa5-43b7-a6d4-b745f1bb8e59 => generated 1331 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:54:05.277860 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-a5f86339-f7f7-44f1-b0f5-cba9d5b50704 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:05.278679 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-a5f86339-f7f7-44f1-b0f5-cba9d5b50704 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: bbeb7a47-a8ee-44b3-bc79-bd12670aaa33] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:05.286210 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-a5f86339-f7f7-44f1-b0f5-cba9d5b50704 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:05.286656 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-a5f86339-f7f7-44f1-b0f5-cba9d5b50704 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:05.287448 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-a5f86339-f7f7-44f1-b0f5-cba9d5b50704 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:05.287875 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-a5f86339-f7f7-44f1-b0f5-cba9d5b50704 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:05.496445 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-a5f86339-f7f7-44f1-b0f5-cba9d5b50704 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:05.510551 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-a5f86339-f7f7-44f1-b0f5-cba9d5b50704 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:05.516935 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-a5f86339-f7f7-44f1-b0f5-cba9d5b50704 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:05.521340 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-a5f86339-f7f7-44f1-b0f5-cba9d5b50704 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33" status: 200 len: 1724 microversion: 2.20 time: 0.253284 Apr 08 02:54:05.522461 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 405/815] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:54:05 2022] GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33 => generated 1724 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:54:06.042632 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-679fad1a-6a45-48f0-93ae-435506450515 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:06.043271 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-679fad1a-6a45-48f0-93ae-435506450515 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 991d0926-dfa5-43b7-a6d4-b745f1bb8e59] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:06.050473 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-679fad1a-6a45-48f0-93ae-435506450515 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:06.050940 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-679fad1a-6a45-48f0-93ae-435506450515 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:06.051707 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-679fad1a-6a45-48f0-93ae-435506450515 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:06.052139 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-679fad1a-6a45-48f0-93ae-435506450515 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:06.101746 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.wsgi [None req-679fad1a-6a45-48f0-93ae-435506450515 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] HTTP exception thrown: Instance 991d0926-dfa5-43b7-a6d4-b745f1bb8e59 could not be found. Apr 08 02:54:06.102341 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-679fad1a-6a45-48f0-93ae-435506450515 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Returning 404 to user: Instance 991d0926-dfa5-43b7-a6d4-b745f1bb8e59 could not be found. {{(pid=96920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Apr 08 02:54:06.103186 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-679fad1a-6a45-48f0-93ae-435506450515 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/991d0926-dfa5-43b7-a6d4-b745f1bb8e59" status: 404 len: 111 microversion: 2.1 time: 0.069919 Apr 08 02:54:06.103747 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 411/816] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:54:06 2022] GET /compute/v2.1/servers/991d0926-dfa5-43b7-a6d4-b745f1bb8e59 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 02:54:06.116708 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-dc1ce39d-e47d-42af-b156-4556433b42b0 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '.version_select at 0x7f7d4e40c4c0>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:06.139654 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-dc1ce39d-e47d-42af-b156-4556433b42b0 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1816110086" status: 202 len: 0 microversion: 2.1 time: 0.031431 Apr 08 02:54:06.140197 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 406/817] 10.222.0.48 () {58 vars in 1220 bytes} [Fri Apr 8 02:54:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1816110086 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 08 02:54:06.545325 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-ef00703d-69e3-4f3f-9d65-b7072476c039 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:06.545950 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-ef00703d-69e3-4f3f-9d65-b7072476c039 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: bbeb7a47-a8ee-44b3-bc79-bd12670aaa33] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:06.553426 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-ef00703d-69e3-4f3f-9d65-b7072476c039 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:06.553872 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-ef00703d-69e3-4f3f-9d65-b7072476c039 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:06.555282 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-ef00703d-69e3-4f3f-9d65-b7072476c039 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:06.555720 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-ef00703d-69e3-4f3f-9d65-b7072476c039 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:07.034512 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-ef00703d-69e3-4f3f-9d65-b7072476c039 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:07.047699 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-ef00703d-69e3-4f3f-9d65-b7072476c039 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:07.054017 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-ef00703d-69e3-4f3f-9d65-b7072476c039 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:07.056079 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-ef00703d-69e3-4f3f-9d65-b7072476c039 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33" status: 200 len: 1724 microversion: 2.20 time: 0.520392 Apr 08 02:54:07.056738 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 412/818] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:54:06 2022] GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33 => generated 1724 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:54:07.260410 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-73be4bc7-aca7-4b53-bc80-666c6d1e06dc tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Action: 'create', calling method: .version_select at 0x7f7d4e31f310>, body: {"keypair": {"name": "tempest-keypair-123723757"}} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:54:07.288608 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.quota [None req-73be4bc7-aca7-4b53-bc80-666c6d1e06dc tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Getting quotas for project cbbf5bb7e51d4d2d8594d6d1d3a797a3. Resources: {'key_pairs'} {{(pid=96919) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:54:07.292918 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.quota [None req-73be4bc7-aca7-4b53-bc80-666c6d1e06dc tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Getting quotas for user b68bc45984974d6da1c9151c21dae14c and project cbbf5bb7e51d4d2d8594d6d1d3a797a3. Resources: {'key_pairs'} {{(pid=96919) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:54:07.862918 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.quota [None req-73be4bc7-aca7-4b53-bc80-666c6d1e06dc tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Getting quotas for project cbbf5bb7e51d4d2d8594d6d1d3a797a3. Resources: {'key_pairs'} {{(pid=96919) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:54:07.866988 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.quota [None req-73be4bc7-aca7-4b53-bc80-666c6d1e06dc tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Getting quotas for user b68bc45984974d6da1c9151c21dae14c and project cbbf5bb7e51d4d2d8594d6d1d3a797a3. Resources: {'key_pairs'} {{(pid=96919) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:54:07.879216 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-73be4bc7-aca7-4b53-bc80-666c6d1e06dc tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.627507 Apr 08 02:54:07.879797 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 407/819] 10.222.0.48 () {60 vars in 1157 bytes} [Fri Apr 8 02:54:07 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:54:08.079324 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-d4166b48-2a01-461c-8a23-ad67b1f5a705 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:08.079902 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-d4166b48-2a01-461c-8a23-ad67b1f5a705 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: bbeb7a47-a8ee-44b3-bc79-bd12670aaa33] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:08.088105 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-d4166b48-2a01-461c-8a23-ad67b1f5a705 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:08.088544 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-d4166b48-2a01-461c-8a23-ad67b1f5a705 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:08.089314 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-d4166b48-2a01-461c-8a23-ad67b1f5a705 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:08.089744 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-d4166b48-2a01-461c-8a23-ad67b1f5a705 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:08.381641 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-d4166b48-2a01-461c-8a23-ad67b1f5a705 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:08.396334 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-d4166b48-2a01-461c-8a23-ad67b1f5a705 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:08.402508 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-d4166b48-2a01-461c-8a23-ad67b1f5a705 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:08.403725 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-d4166b48-2a01-461c-8a23-ad67b1f5a705 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33" status: 200 len: 1724 microversion: 2.20 time: 0.334283 Apr 08 02:54:08.404248 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 413/820] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:54:08 2022] GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33 => generated 1724 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:54:09.426748 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-c2f9ec1e-1403-4e4a-96f4-15bf393c273a tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:09.427290 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-c2f9ec1e-1403-4e4a-96f4-15bf393c273a tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: bbeb7a47-a8ee-44b3-bc79-bd12670aaa33] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:09.434418 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-c2f9ec1e-1403-4e4a-96f4-15bf393c273a tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:09.434896 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-c2f9ec1e-1403-4e4a-96f4-15bf393c273a tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:09.435674 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-c2f9ec1e-1403-4e4a-96f4-15bf393c273a tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:09.436107 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-c2f9ec1e-1403-4e4a-96f4-15bf393c273a tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:09.831759 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-20905f33-6d4c-4fc3-9640-737089980dde tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-890399816", "imageRef": "7f8ca061-f382-4052-8d05-69f37e107684", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8b5bf61a-9182-47e6-a758-1a71619fdd20"}], "security_groups": [{"name": "tempest-securitygroup--445584235"}], "key_name": "tempest-keypair-123723757", "user_data": "}} {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:54:09.843619 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-c2f9ec1e-1403-4e4a-96f4-15bf393c273a tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:09.856670 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-c2f9ec1e-1403-4e4a-96f4-15bf393c273a tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:09.862707 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-c2f9ec1e-1403-4e4a-96f4-15bf393c273a tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:09.863817 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-c2f9ec1e-1403-4e4a-96f4-15bf393c273a tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33" status: 200 len: 1724 microversion: 2.20 time: 0.446343 Apr 08 02:54:09.864335 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 408/821] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:54:09 2022] GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33 => generated 1724 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:54:09.965227 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.network.neutron [None req-20905f33-6d4c-4fc3-9640-737089980dde tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] validate_networks() for [('8b5bf61a-9182-47e6-a758-1a71619fdd20', None, None, None)] {{(pid=96920) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} Apr 08 02:54:10.485995 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.virt.hardware [None req-20905f33-6d4c-4fc3-9640-737089980dde tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Flavor limits 0:0:0 {{(pid=96920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} Apr 08 02:54:10.486409 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.virt.hardware [None req-20905f33-6d4c-4fc3-9640-737089980dde tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Image limits 0:0:0 {{(pid=96920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} Apr 08 02:54:10.486901 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.virt.hardware [None req-20905f33-6d4c-4fc3-9640-737089980dde tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Flavor pref 0:0:0 {{(pid=96920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} Apr 08 02:54:10.487303 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.virt.hardware [None req-20905f33-6d4c-4fc3-9640-737089980dde tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Image pref 0:0:0 {{(pid=96920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} Apr 08 02:54:10.487705 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.virt.hardware [None req-20905f33-6d4c-4fc3-9640-737089980dde tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=96920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} Apr 08 02:54:10.496489 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-20905f33-6d4c-4fc3-9640-737089980dde tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:10.496924 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-20905f33-6d4c-4fc3-9640-737089980dde tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:10.497709 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-20905f33-6d4c-4fc3-9640-737089980dde tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:10.498131 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-20905f33-6d4c-4fc3-9640-737089980dde tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:10.515247 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.quota [None req-20905f33-6d4c-4fc3-9640-737089980dde tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Getting quotas for project cbbf5bb7e51d4d2d8594d6d1d3a797a3. Resources: {'instances', 'cores', 'ram'} {{(pid=96920) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:54:10.519099 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.quota [None req-20905f33-6d4c-4fc3-9640-737089980dde tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Getting quotas for user b68bc45984974d6da1c9151c21dae14c and project cbbf5bb7e51d4d2d8594d6d1d3a797a3. Resources: {'instances', 'cores', 'ram'} {{(pid=96920) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:54:10.529985 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-20905f33-6d4c-4fc3-9640-737089980dde tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Going to run 1 instances... {{(pid=96920) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} Apr 08 02:54:10.532248 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-20905f33-6d4c-4fc3-9640-737089980dde tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 0e706772-9e50-42af-9390-833fc586edb5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7f8ca061-f382-4052-8d05-69f37e107684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=96920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} Apr 08 02:54:10.576298 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-20905f33-6d4c-4fc3-9640-737089980dde tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.753980 Apr 08 02:54:10.576925 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 414/822] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Apr 8 02:54:09 2022] POST /compute/v2.1/servers => generated 401 bytes in 755 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 08 02:54:10.592485 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-88f98d0c-675c-4434-9e7e-3304bc7f0610 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:10.593088 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-88f98d0c-675c-4434-9e7e-3304bc7f0610 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 0e706772-9e50-42af-9390-833fc586edb5] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:10.669796 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-88f98d0c-675c-4434-9e7e-3304bc7f0610 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68bc45984974d6da1c9151c21dae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbf5bb7e51d4d2d8594d6d1d3a797a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:10.677793 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-88f98d0c-675c-4434-9e7e-3304bc7f0610 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/0e706772-9e50-42af-9390-833fc586edb5" status: 200 len: 1240 microversion: 2.1 time: 0.094256 Apr 08 02:54:10.678337 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 409/823] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:54:10 2022] GET /compute/v2.1/servers/0e706772-9e50-42af-9390-833fc586edb5 => generated 1240 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:54:10.887706 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-f1daf978-6523-49bc-9ef1-6813db2df5e3 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:10.888327 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-f1daf978-6523-49bc-9ef1-6813db2df5e3 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: bbeb7a47-a8ee-44b3-bc79-bd12670aaa33] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:10.895736 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-f1daf978-6523-49bc-9ef1-6813db2df5e3 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:10.896179 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-f1daf978-6523-49bc-9ef1-6813db2df5e3 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:10.896959 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-f1daf978-6523-49bc-9ef1-6813db2df5e3 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:10.897572 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-f1daf978-6523-49bc-9ef1-6813db2df5e3 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:11.106632 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-f1daf978-6523-49bc-9ef1-6813db2df5e3 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:11.120653 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-f1daf978-6523-49bc-9ef1-6813db2df5e3 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:11.126646 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-f1daf978-6523-49bc-9ef1-6813db2df5e3 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:11.127845 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-f1daf978-6523-49bc-9ef1-6813db2df5e3 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33" status: 200 len: 1745 microversion: 2.20 time: 0.250401 Apr 08 02:54:11.128376 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 415/824] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:54:10 2022] GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33 => generated 1745 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:54:11.701279 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-bf59b201-6f9a-4fd7-99fd-8bf2780c80cd tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:11.701873 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-bf59b201-6f9a-4fd7-99fd-8bf2780c80cd tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 0e706772-9e50-42af-9390-833fc586edb5] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:11.709232 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-bf59b201-6f9a-4fd7-99fd-8bf2780c80cd tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:11.709669 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-bf59b201-6f9a-4fd7-99fd-8bf2780c80cd tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:11.710477 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-bf59b201-6f9a-4fd7-99fd-8bf2780c80cd tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:11.711493 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-bf59b201-6f9a-4fd7-99fd-8bf2780c80cd tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:11.845596 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-bf59b201-6f9a-4fd7-99fd-8bf2780c80cd tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68bc45984974d6da1c9151c21dae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbf5bb7e51d4d2d8594d6d1d3a797a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:11.854738 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-bf59b201-6f9a-4fd7-99fd-8bf2780c80cd tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/0e706772-9e50-42af-9390-833fc586edb5" status: 200 len: 1310 microversion: 2.1 time: 0.163362 Apr 08 02:54:11.855831 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 410/825] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:54:11 2022] GET /compute/v2.1/servers/0e706772-9e50-42af-9390-833fc586edb5 => generated 1310 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:54:12.152332 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-840c7eaf-8e33-4063-b3ec-d0f87ebe4f82 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:12.152929 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-840c7eaf-8e33-4063-b3ec-d0f87ebe4f82 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: bbeb7a47-a8ee-44b3-bc79-bd12670aaa33] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:12.160147 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-840c7eaf-8e33-4063-b3ec-d0f87ebe4f82 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:12.160586 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-840c7eaf-8e33-4063-b3ec-d0f87ebe4f82 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:12.161347 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-840c7eaf-8e33-4063-b3ec-d0f87ebe4f82 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:12.161770 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-840c7eaf-8e33-4063-b3ec-d0f87ebe4f82 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:12.361419 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-840c7eaf-8e33-4063-b3ec-d0f87ebe4f82 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:12.376247 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-840c7eaf-8e33-4063-b3ec-d0f87ebe4f82 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:12.382271 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-840c7eaf-8e33-4063-b3ec-d0f87ebe4f82 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:12.384577 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-840c7eaf-8e33-4063-b3ec-d0f87ebe4f82 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33" status: 200 len: 1745 microversion: 2.20 time: 0.241305 Apr 08 02:54:12.385126 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 416/826] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:54:12 2022] GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33 => generated 1745 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:54:12.879269 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-0b51a9b0-8d56-4205-acb5-e696670d1236 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:12.879876 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-0b51a9b0-8d56-4205-acb5-e696670d1236 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 0e706772-9e50-42af-9390-833fc586edb5] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:12.888067 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-0b51a9b0-8d56-4205-acb5-e696670d1236 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:12.888729 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-0b51a9b0-8d56-4205-acb5-e696670d1236 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:12.889718 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-0b51a9b0-8d56-4205-acb5-e696670d1236 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:12.890273 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-0b51a9b0-8d56-4205-acb5-e696670d1236 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:13.120669 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-0b51a9b0-8d56-4205-acb5-e696670d1236 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68bc45984974d6da1c9151c21dae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbf5bb7e51d4d2d8594d6d1d3a797a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:13.130556 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-0b51a9b0-8d56-4205-acb5-e696670d1236 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/0e706772-9e50-42af-9390-833fc586edb5" status: 200 len: 1365 microversion: 2.1 time: 0.260249 Apr 08 02:54:13.140543 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 411/827] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:54:12 2022] GET /compute/v2.1/servers/0e706772-9e50-42af-9390-833fc586edb5 => generated 1365 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:54:13.409319 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-afd472f9-1261-4d34-8bc2-d8011c47885c tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:13.410388 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-afd472f9-1261-4d34-8bc2-d8011c47885c tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: bbeb7a47-a8ee-44b3-bc79-bd12670aaa33] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:13.418470 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-afd472f9-1261-4d34-8bc2-d8011c47885c tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:13.418951 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-afd472f9-1261-4d34-8bc2-d8011c47885c tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:13.419720 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-afd472f9-1261-4d34-8bc2-d8011c47885c tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:13.420151 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-afd472f9-1261-4d34-8bc2-d8011c47885c tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:13.489333 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [req-f1f57462-ae2f-4a33-85bc-6af180f13e29 req-a2dc736c-3261-444b-b2b7-70268f528051 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e706772-9e50-42af-9390-833fc586edb5", "tag": "eb3af547-8a95-465b-b99d-7ab718c88e31"}]} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:54:13.505282 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:54:13.505282 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: warnings.warn(msg) Apr 08 02:54:13.515050 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-f1f57462-ae2f-4a33-85bc-6af180f13e29 req-a2dc736c-3261-444b-b2b7-70268f528051 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:13.515494 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-f1f57462-ae2f-4a33-85bc-6af180f13e29 req-a2dc736c-3261-444b-b2b7-70268f528051 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:13.532588 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.compute.server_external_events [req-f1f57462-ae2f-4a33-85bc-6af180f13e29 req-a2dc736c-3261-444b-b2b7-70268f528051 service nova] Creating event network-changed:eb3af547-8a95-465b-b99d-7ab718c88e31 for instance 0e706772-9e50-42af-9390-833fc586edb5 on hv-cinder-83705 Apr 08 02:54:13.537607 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [req-f1f57462-ae2f-4a33-85bc-6af180f13e29 req-a2dc736c-3261-444b-b2b7-70268f528051 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064550 Apr 08 02:54:13.539284 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 412/828] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:54:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 02:54:13.649324 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-afd472f9-1261-4d34-8bc2-d8011c47885c tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:13.662625 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-afd472f9-1261-4d34-8bc2-d8011c47885c tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:13.669159 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-afd472f9-1261-4d34-8bc2-d8011c47885c tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:13.670302 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-afd472f9-1261-4d34-8bc2-d8011c47885c tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33" status: 200 len: 1745 microversion: 2.20 time: 0.271149 Apr 08 02:54:13.670926 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 417/829] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:54:13 2022] GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33 => generated 1745 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:54:14.153883 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-17835344-8704-4b89-a47b-713084919f37 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:14.154568 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-17835344-8704-4b89-a47b-713084919f37 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 0e706772-9e50-42af-9390-833fc586edb5] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:14.161878 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-17835344-8704-4b89-a47b-713084919f37 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:14.162318 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-17835344-8704-4b89-a47b-713084919f37 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:14.163119 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-17835344-8704-4b89-a47b-713084919f37 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:14.164190 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-17835344-8704-4b89-a47b-713084919f37 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:14.363743 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-17835344-8704-4b89-a47b-713084919f37 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68bc45984974d6da1c9151c21dae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbf5bb7e51d4d2d8594d6d1d3a797a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:14.371754 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-17835344-8704-4b89-a47b-713084919f37 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/0e706772-9e50-42af-9390-833fc586edb5" status: 200 len: 1365 microversion: 2.1 time: 0.227329 Apr 08 02:54:14.372285 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 413/830] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:54:14 2022] GET /compute/v2.1/servers/0e706772-9e50-42af-9390-833fc586edb5 => generated 1365 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:54:14.693735 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-8c2bc55d-6ef1-48b5-ad50-92bc4c86c810 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:14.694502 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-8c2bc55d-6ef1-48b5-ad50-92bc4c86c810 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: bbeb7a47-a8ee-44b3-bc79-bd12670aaa33] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:14.702034 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-8c2bc55d-6ef1-48b5-ad50-92bc4c86c810 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:14.702577 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-8c2bc55d-6ef1-48b5-ad50-92bc4c86c810 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:14.703479 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-8c2bc55d-6ef1-48b5-ad50-92bc4c86c810 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:14.703999 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-8c2bc55d-6ef1-48b5-ad50-92bc4c86c810 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:14.851656 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [req-c51111dd-acdb-46ab-a5f2-50c2c7629e18 req-6a997146-040d-430d-856e-c540b9eeeb5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbeb7a47-a8ee-44b3-bc79-bd12670aaa33", "name": "network-vif-plugged", "status": "completed", "tag": "2bd62dce-ca58-4c9e-bb8a-99411d102c48"}]} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:54:14.858220 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:54:14.858220 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: warnings.warn(msg) Apr 08 02:54:14.866409 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-c51111dd-acdb-46ab-a5f2-50c2c7629e18 req-6a997146-040d-430d-856e-c540b9eeeb5e service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:14.866972 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-c51111dd-acdb-46ab-a5f2-50c2c7629e18 req-6a997146-040d-430d-856e-c540b9eeeb5e service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:14.883905 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.compute.server_external_events [req-c51111dd-acdb-46ab-a5f2-50c2c7629e18 req-6a997146-040d-430d-856e-c540b9eeeb5e service nova] Creating event network-vif-plugged:2bd62dce-ca58-4c9e-bb8a-99411d102c48 for instance bbeb7a47-a8ee-44b3-bc79-bd12670aaa33 on hv-cinder-83705 Apr 08 02:54:14.888802 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [req-c51111dd-acdb-46ab-a5f2-50c2c7629e18 req-6a997146-040d-430d-856e-c540b9eeeb5e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047551 Apr 08 02:54:14.889386 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 414/831] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:54:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 02:54:14.915821 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-8c2bc55d-6ef1-48b5-ad50-92bc4c86c810 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:14.930004 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-8c2bc55d-6ef1-48b5-ad50-92bc4c86c810 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:14.936354 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-8c2bc55d-6ef1-48b5-ad50-92bc4c86c810 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:14.937487 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-8c2bc55d-6ef1-48b5-ad50-92bc4c86c810 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33" status: 200 len: 1745 microversion: 2.20 time: 0.252941 Apr 08 02:54:14.938003 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 418/832] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:54:14 2022] GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33 => generated 1745 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:54:15.395177 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-84c0fab5-1d63-4f19-b832-d6ef5647c653 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:15.395874 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-84c0fab5-1d63-4f19-b832-d6ef5647c653 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 0e706772-9e50-42af-9390-833fc586edb5] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:15.404250 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-84c0fab5-1d63-4f19-b832-d6ef5647c653 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:15.404691 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-84c0fab5-1d63-4f19-b832-d6ef5647c653 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:15.405459 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-84c0fab5-1d63-4f19-b832-d6ef5647c653 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:15.405892 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-84c0fab5-1d63-4f19-b832-d6ef5647c653 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:15.603499 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-84c0fab5-1d63-4f19-b832-d6ef5647c653 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68bc45984974d6da1c9151c21dae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbf5bb7e51d4d2d8594d6d1d3a797a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:15.611654 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-84c0fab5-1d63-4f19-b832-d6ef5647c653 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/0e706772-9e50-42af-9390-833fc586edb5" status: 200 len: 1365 microversion: 2.1 time: 0.226160 Apr 08 02:54:15.612196 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 415/833] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:54:15 2022] GET /compute/v2.1/servers/0e706772-9e50-42af-9390-833fc586edb5 => generated 1365 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:54:15.962325 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-57f10667-750c-41dc-ad20-df406a320d9d tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:15.962940 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-57f10667-750c-41dc-ad20-df406a320d9d tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: bbeb7a47-a8ee-44b3-bc79-bd12670aaa33] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:15.970133 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-57f10667-750c-41dc-ad20-df406a320d9d tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:15.970568 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-57f10667-750c-41dc-ad20-df406a320d9d tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:15.971382 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-57f10667-750c-41dc-ad20-df406a320d9d tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:15.971806 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-57f10667-750c-41dc-ad20-df406a320d9d tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:16.172609 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-57f10667-750c-41dc-ad20-df406a320d9d tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:16.186250 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-57f10667-750c-41dc-ad20-df406a320d9d tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:16.192261 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-57f10667-750c-41dc-ad20-df406a320d9d tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:16.193338 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-57f10667-750c-41dc-ad20-df406a320d9d tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33" status: 200 len: 1745 microversion: 2.20 time: 0.240220 Apr 08 02:54:16.193868 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 419/834] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:54:15 2022] GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33 => generated 1745 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:54:16.635559 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-78b4c5b6-caf3-4494-beb5-46078de48f74 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:16.636161 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-78b4c5b6-caf3-4494-beb5-46078de48f74 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 0e706772-9e50-42af-9390-833fc586edb5] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:16.643614 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-78b4c5b6-caf3-4494-beb5-46078de48f74 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:16.644051 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-78b4c5b6-caf3-4494-beb5-46078de48f74 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:16.644803 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-78b4c5b6-caf3-4494-beb5-46078de48f74 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:16.645227 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-78b4c5b6-caf3-4494-beb5-46078de48f74 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:16.842735 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-78b4c5b6-caf3-4494-beb5-46078de48f74 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68bc45984974d6da1c9151c21dae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbf5bb7e51d4d2d8594d6d1d3a797a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:16.850645 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-78b4c5b6-caf3-4494-beb5-46078de48f74 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/0e706772-9e50-42af-9390-833fc586edb5" status: 200 len: 1365 microversion: 2.1 time: 0.226255 Apr 08 02:54:16.851868 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 416/835] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:54:16 2022] GET /compute/v2.1/servers/0e706772-9e50-42af-9390-833fc586edb5 => generated 1365 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:54:17.217125 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-90196e05-be31-4695-be48-a8c7dfecd0e6 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:17.217734 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-90196e05-be31-4695-be48-a8c7dfecd0e6 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: bbeb7a47-a8ee-44b3-bc79-bd12670aaa33] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:17.225003 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-90196e05-be31-4695-be48-a8c7dfecd0e6 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:17.225452 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-90196e05-be31-4695-be48-a8c7dfecd0e6 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:17.226936 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-90196e05-be31-4695-be48-a8c7dfecd0e6 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:17.227388 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-90196e05-be31-4695-be48-a8c7dfecd0e6 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:17.449775 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-90196e05-be31-4695-be48-a8c7dfecd0e6 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:17.463321 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-90196e05-be31-4695-be48-a8c7dfecd0e6 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:17.471431 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-90196e05-be31-4695-be48-a8c7dfecd0e6 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:17.472605 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-90196e05-be31-4695-be48-a8c7dfecd0e6 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33" status: 200 len: 1740 microversion: 2.20 time: 0.266367 Apr 08 02:54:17.473182 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 420/836] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:54:17 2022] GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33 => generated 1740 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:54:17.872847 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-b1be507c-41e6-48c2-88d8-3bdcd2dbcb81 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:17.873356 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-b1be507c-41e6-48c2-88d8-3bdcd2dbcb81 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 0e706772-9e50-42af-9390-833fc586edb5] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:17.880839 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b1be507c-41e6-48c2-88d8-3bdcd2dbcb81 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:17.881508 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b1be507c-41e6-48c2-88d8-3bdcd2dbcb81 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:17.883015 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b1be507c-41e6-48c2-88d8-3bdcd2dbcb81 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:17.883621 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b1be507c-41e6-48c2-88d8-3bdcd2dbcb81 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:18.199310 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-b1be507c-41e6-48c2-88d8-3bdcd2dbcb81 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68bc45984974d6da1c9151c21dae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbf5bb7e51d4d2d8594d6d1d3a797a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:18.209443 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-b1be507c-41e6-48c2-88d8-3bdcd2dbcb81 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/0e706772-9e50-42af-9390-833fc586edb5" status: 200 len: 1365 microversion: 2.1 time: 0.345731 Apr 08 02:54:18.219785 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 417/837] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:54:17 2022] GET /compute/v2.1/servers/0e706772-9e50-42af-9390-833fc586edb5 => generated 1365 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:54:18.497855 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-ee2eb336-b90c-4943-8ef6-c45ddb0018f4 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:18.498381 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-ee2eb336-b90c-4943-8ef6-c45ddb0018f4 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: bbeb7a47-a8ee-44b3-bc79-bd12670aaa33] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:18.505816 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-ee2eb336-b90c-4943-8ef6-c45ddb0018f4 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:18.506459 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-ee2eb336-b90c-4943-8ef6-c45ddb0018f4 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:18.507706 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-ee2eb336-b90c-4943-8ef6-c45ddb0018f4 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:18.508446 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-ee2eb336-b90c-4943-8ef6-c45ddb0018f4 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:18.772155 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-ee2eb336-b90c-4943-8ef6-c45ddb0018f4 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:18.786977 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-ee2eb336-b90c-4943-8ef6-c45ddb0018f4 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:18.809216 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-ee2eb336-b90c-4943-8ef6-c45ddb0018f4 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:18.810760 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-ee2eb336-b90c-4943-8ef6-c45ddb0018f4 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33" status: 200 len: 1740 microversion: 2.20 time: 0.322549 Apr 08 02:54:18.835058 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 421/838] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:54:18 2022] GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33 => generated 1740 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:54:19.231447 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-cf178841-4ddd-4427-a984-c6c000ead9c8 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:19.232157 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-cf178841-4ddd-4427-a984-c6c000ead9c8 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 0e706772-9e50-42af-9390-833fc586edb5] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:19.240140 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-cf178841-4ddd-4427-a984-c6c000ead9c8 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:19.240661 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-cf178841-4ddd-4427-a984-c6c000ead9c8 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:19.241558 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-cf178841-4ddd-4427-a984-c6c000ead9c8 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:19.242093 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-cf178841-4ddd-4427-a984-c6c000ead9c8 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:19.481031 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-cf178841-4ddd-4427-a984-c6c000ead9c8 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68bc45984974d6da1c9151c21dae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbf5bb7e51d4d2d8594d6d1d3a797a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:19.490916 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-cf178841-4ddd-4427-a984-c6c000ead9c8 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/0e706772-9e50-42af-9390-833fc586edb5" status: 200 len: 1365 microversion: 2.1 time: 0.268515 Apr 08 02:54:19.501982 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 418/839] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:54:19 2022] GET /compute/v2.1/servers/0e706772-9e50-42af-9390-833fc586edb5 => generated 1365 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:54:19.847306 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-dfb7609b-18e6-4c9e-bb60-af3c67d262e4 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:19.848603 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-dfb7609b-18e6-4c9e-bb60-af3c67d262e4 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: bbeb7a47-a8ee-44b3-bc79-bd12670aaa33] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:19.858041 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-dfb7609b-18e6-4c9e-bb60-af3c67d262e4 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:19.858490 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-dfb7609b-18e6-4c9e-bb60-af3c67d262e4 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:19.859308 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-dfb7609b-18e6-4c9e-bb60-af3c67d262e4 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:19.859741 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-dfb7609b-18e6-4c9e-bb60-af3c67d262e4 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:20.102829 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-dfb7609b-18e6-4c9e-bb60-af3c67d262e4 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:20.113987 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-dfb7609b-18e6-4c9e-bb60-af3c67d262e4 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:20.121160 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-dfb7609b-18e6-4c9e-bb60-af3c67d262e4 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:20.122329 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-dfb7609b-18e6-4c9e-bb60-af3c67d262e4 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33" status: 200 len: 1740 microversion: 2.20 time: 0.284409 Apr 08 02:54:20.122870 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 422/840] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:54:19 2022] GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33 => generated 1740 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:54:20.514550 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-0379eb9f-352f-40f6-a3b5-8029ed88771c tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:20.515543 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-0379eb9f-352f-40f6-a3b5-8029ed88771c tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 0e706772-9e50-42af-9390-833fc586edb5] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:20.523844 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-0379eb9f-352f-40f6-a3b5-8029ed88771c tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:20.524599 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-0379eb9f-352f-40f6-a3b5-8029ed88771c tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:20.525586 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-0379eb9f-352f-40f6-a3b5-8029ed88771c tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:20.526025 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-0379eb9f-352f-40f6-a3b5-8029ed88771c tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:20.751697 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-0379eb9f-352f-40f6-a3b5-8029ed88771c tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68bc45984974d6da1c9151c21dae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbf5bb7e51d4d2d8594d6d1d3a797a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:20.760901 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-0379eb9f-352f-40f6-a3b5-8029ed88771c tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/0e706772-9e50-42af-9390-833fc586edb5" status: 200 len: 1365 microversion: 2.1 time: 0.256035 Apr 08 02:54:20.761439 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 419/841] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:54:20 2022] GET /compute/v2.1/servers/0e706772-9e50-42af-9390-833fc586edb5 => generated 1365 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:54:20.937442 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [req-d71c147e-ec4e-427f-9fed-c7efe158914c req-0bb824e1-d3e5-4870-a22b-b6870aae6dd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e706772-9e50-42af-9390-833fc586edb5", "name": "network-vif-plugged", "status": "completed", "tag": "eb3af547-8a95-465b-b99d-7ab718c88e31"}]} {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:54:20.945631 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:54:20.945631 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: warnings.warn(msg) Apr 08 02:54:20.954953 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-d71c147e-ec4e-427f-9fed-c7efe158914c req-0bb824e1-d3e5-4870-a22b-b6870aae6dd8 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:20.955712 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-d71c147e-ec4e-427f-9fed-c7efe158914c req-0bb824e1-d3e5-4870-a22b-b6870aae6dd8 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:20.973611 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.compute.server_external_events [req-d71c147e-ec4e-427f-9fed-c7efe158914c req-0bb824e1-d3e5-4870-a22b-b6870aae6dd8 service nova] Creating event network-vif-plugged:eb3af547-8a95-465b-b99d-7ab718c88e31 for instance 0e706772-9e50-42af-9390-833fc586edb5 on hv-cinder-83705 Apr 08 02:54:20.979387 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [req-d71c147e-ec4e-427f-9fed-c7efe158914c req-0bb824e1-d3e5-4870-a22b-b6870aae6dd8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054402 Apr 08 02:54:20.980346 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 423/842] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:54:21.146027 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-5f491d1e-c0b8-4704-86e5-5508ecc13dd9 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:21.146335 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-5f491d1e-c0b8-4704-86e5-5508ecc13dd9 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: bbeb7a47-a8ee-44b3-bc79-bd12670aaa33] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:21.154319 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-5f491d1e-c0b8-4704-86e5-5508ecc13dd9 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:21.154879 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-5f491d1e-c0b8-4704-86e5-5508ecc13dd9 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:21.155747 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-5f491d1e-c0b8-4704-86e5-5508ecc13dd9 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:21.156245 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-5f491d1e-c0b8-4704-86e5-5508ecc13dd9 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:21.371712 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-5f491d1e-c0b8-4704-86e5-5508ecc13dd9 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:21.386042 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-5f491d1e-c0b8-4704-86e5-5508ecc13dd9 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:21.392447 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-5f491d1e-c0b8-4704-86e5-5508ecc13dd9 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:21.393624 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-5f491d1e-c0b8-4704-86e5-5508ecc13dd9 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33" status: 200 len: 1740 microversion: 2.20 time: 0.257385 Apr 08 02:54:21.394158 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 420/843] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:54:21 2022] GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33 => generated 1740 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:54:21.784140 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-f4465530-183d-429c-a87b-7a63fad8c86c tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:21.784835 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-f4465530-183d-429c-a87b-7a63fad8c86c tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 0e706772-9e50-42af-9390-833fc586edb5] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:21.794231 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-f4465530-183d-429c-a87b-7a63fad8c86c tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:21.795206 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-f4465530-183d-429c-a87b-7a63fad8c86c tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:21.796414 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-f4465530-183d-429c-a87b-7a63fad8c86c tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:21.797099 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-f4465530-183d-429c-a87b-7a63fad8c86c tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:22.030806 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-f4465530-183d-429c-a87b-7a63fad8c86c tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68bc45984974d6da1c9151c21dae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbf5bb7e51d4d2d8594d6d1d3a797a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:22.039781 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-f4465530-183d-429c-a87b-7a63fad8c86c tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/0e706772-9e50-42af-9390-833fc586edb5" status: 200 len: 1365 microversion: 2.1 time: 0.265437 Apr 08 02:54:22.040417 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 424/844] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:54:21 2022] GET /compute/v2.1/servers/0e706772-9e50-42af-9390-833fc586edb5 => generated 1365 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:54:22.420241 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-959dc76f-92be-46e8-8af1-4bf94a176eef tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:22.420867 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-959dc76f-92be-46e8-8af1-4bf94a176eef tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: bbeb7a47-a8ee-44b3-bc79-bd12670aaa33] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:22.432243 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-959dc76f-92be-46e8-8af1-4bf94a176eef tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:22.433080 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-959dc76f-92be-46e8-8af1-4bf94a176eef tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:22.434537 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-959dc76f-92be-46e8-8af1-4bf94a176eef tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:22.434998 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-959dc76f-92be-46e8-8af1-4bf94a176eef tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:22.676617 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-959dc76f-92be-46e8-8af1-4bf94a176eef tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:22.694335 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-959dc76f-92be-46e8-8af1-4bf94a176eef tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:22.701416 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-959dc76f-92be-46e8-8af1-4bf94a176eef tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:22.703977 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-959dc76f-92be-46e8-8af1-4bf94a176eef tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33" status: 200 len: 1740 microversion: 2.20 time: 0.293259 Apr 08 02:54:22.704892 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 421/845] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:54:22 2022] GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33 => generated 1740 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:54:23.064729 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-3e984f0a-fafd-4e50-a8e9-15772d58274a tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:23.065388 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-3e984f0a-fafd-4e50-a8e9-15772d58274a tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 0e706772-9e50-42af-9390-833fc586edb5] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:23.083255 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-3e984f0a-fafd-4e50-a8e9-15772d58274a tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:23.084123 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-3e984f0a-fafd-4e50-a8e9-15772d58274a tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:23.085738 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-3e984f0a-fafd-4e50-a8e9-15772d58274a tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:23.086290 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-3e984f0a-fafd-4e50-a8e9-15772d58274a tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:23.312740 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-3e984f0a-fafd-4e50-a8e9-15772d58274a tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68bc45984974d6da1c9151c21dae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbf5bb7e51d4d2d8594d6d1d3a797a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:23.322559 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-3e984f0a-fafd-4e50-a8e9-15772d58274a tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/0e706772-9e50-42af-9390-833fc586edb5" status: 200 len: 1554 microversion: 2.1 time: 0.269543 Apr 08 02:54:23.323327 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 425/846] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:54:23 2022] GET /compute/v2.1/servers/0e706772-9e50-42af-9390-833fc586edb5 => generated 1554 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:54:23.353936 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-7075fca2-3461-4584-8597-b0dd6c5c07f6 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:23.354536 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-7075fca2-3461-4584-8597-b0dd6c5c07f6 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 0e706772-9e50-42af-9390-833fc586edb5] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:23.363824 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-7075fca2-3461-4584-8597-b0dd6c5c07f6 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:23.364268 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-7075fca2-3461-4584-8597-b0dd6c5c07f6 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:23.365064 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-7075fca2-3461-4584-8597-b0dd6c5c07f6 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:23.365490 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-7075fca2-3461-4584-8597-b0dd6c5c07f6 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:23.545222 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-7075fca2-3461-4584-8597-b0dd6c5c07f6 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/0e706772-9e50-42af-9390-833fc586edb5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.206249 Apr 08 02:54:23.545881 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 422/847] 10.222.0.48 () {58 vars in 1274 bytes} [Fri Apr 8 02:54:23 2022] GET /compute/v2.1/servers/0e706772-9e50-42af-9390-833fc586edb5/os-interface => generated 284 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:54:23.728444 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-7637f5d3-bed8-490d-8f72-81bde3dc5f8e tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:23.729488 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-7637f5d3-bed8-490d-8f72-81bde3dc5f8e tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: bbeb7a47-a8ee-44b3-bc79-bd12670aaa33] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:23.737896 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-7637f5d3-bed8-490d-8f72-81bde3dc5f8e tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:23.738699 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-7637f5d3-bed8-490d-8f72-81bde3dc5f8e tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:23.739711 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-7637f5d3-bed8-490d-8f72-81bde3dc5f8e tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:23.740356 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-7637f5d3-bed8-490d-8f72-81bde3dc5f8e tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:24.227739 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-7637f5d3-bed8-490d-8f72-81bde3dc5f8e tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:24.242317 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-7637f5d3-bed8-490d-8f72-81bde3dc5f8e tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:24.249317 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-7637f5d3-bed8-490d-8f72-81bde3dc5f8e tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:24.250836 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-7637f5d3-bed8-490d-8f72-81bde3dc5f8e tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33" status: 200 len: 1740 microversion: 2.20 time: 0.532237 Apr 08 02:54:24.261807 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 426/848] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:54:23 2022] GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33 => generated 1740 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:54:25.278232 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-ca6ac89a-698b-4454-aa5a-3f80f6326838 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:25.278843 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-ca6ac89a-698b-4454-aa5a-3f80f6326838 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: bbeb7a47-a8ee-44b3-bc79-bd12670aaa33] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:25.287781 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ca6ac89a-698b-4454-aa5a-3f80f6326838 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:25.288452 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ca6ac89a-698b-4454-aa5a-3f80f6326838 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:25.289227 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ca6ac89a-698b-4454-aa5a-3f80f6326838 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:25.289654 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ca6ac89a-698b-4454-aa5a-3f80f6326838 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:25.591397 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [req-b4dd1b4d-598f-47fb-b83f-ae1841fc209c req-802f2442-f932-482e-af61-499a9860c5ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e706772-9e50-42af-9390-833fc586edb5", "tag": "eb3af547-8a95-465b-b99d-7ab718c88e31"}]} {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:54:25.599375 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:54:25.599375 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: warnings.warn(msg) Apr 08 02:54:25.602952 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-ca6ac89a-698b-4454-aa5a-3f80f6326838 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:25.614097 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-b4dd1b4d-598f-47fb-b83f-ae1841fc209c req-802f2442-f932-482e-af61-499a9860c5ab service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:25.615018 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-b4dd1b4d-598f-47fb-b83f-ae1841fc209c req-802f2442-f932-482e-af61-499a9860c5ab service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:25.626401 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-ca6ac89a-698b-4454-aa5a-3f80f6326838 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:25.635335 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.compute.server_external_events [req-b4dd1b4d-598f-47fb-b83f-ae1841fc209c req-802f2442-f932-482e-af61-499a9860c5ab service nova] Creating event network-changed:eb3af547-8a95-465b-b99d-7ab718c88e31 for instance 0e706772-9e50-42af-9390-833fc586edb5 on hv-cinder-83705 Apr 08 02:54:25.639201 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-ca6ac89a-698b-4454-aa5a-3f80f6326838 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:25.640351 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-ca6ac89a-698b-4454-aa5a-3f80f6326838 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33" status: 200 len: 1740 microversion: 2.20 time: 0.373011 Apr 08 02:54:25.641242 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 423/849] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:54:25 2022] GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33 => generated 1740 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:54:25.642334 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [req-b4dd1b4d-598f-47fb-b83f-ae1841fc209c req-802f2442-f932-482e-af61-499a9860c5ab service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067322 Apr 08 02:54:25.643467 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 427/850] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:54:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:54:26.671212 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-19f70620-4715-44a9-98de-b4d084becfba tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:26.673341 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-19f70620-4715-44a9-98de-b4d084becfba tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: bbeb7a47-a8ee-44b3-bc79-bd12670aaa33] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:26.685522 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-19f70620-4715-44a9-98de-b4d084becfba tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:26.686194 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-19f70620-4715-44a9-98de-b4d084becfba tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:26.688252 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-19f70620-4715-44a9-98de-b4d084becfba tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:26.689076 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-19f70620-4715-44a9-98de-b4d084becfba tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:26.938513 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-19f70620-4715-44a9-98de-b4d084becfba tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:26.966728 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-19f70620-4715-44a9-98de-b4d084becfba tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:26.987408 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-19f70620-4715-44a9-98de-b4d084becfba tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:26.994968 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-19f70620-4715-44a9-98de-b4d084becfba tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33" status: 200 len: 1740 microversion: 2.20 time: 0.332904 Apr 08 02:54:27.006753 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 424/851] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:54:26 2022] GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33 => generated 1740 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:54:28.021670 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-c3f38e27-43f7-47a4-8e8a-d955b0a8db79 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:28.022362 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-c3f38e27-43f7-47a4-8e8a-d955b0a8db79 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: bbeb7a47-a8ee-44b3-bc79-bd12670aaa33] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:28.030060 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c3f38e27-43f7-47a4-8e8a-d955b0a8db79 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:28.030538 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c3f38e27-43f7-47a4-8e8a-d955b0a8db79 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:28.031338 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c3f38e27-43f7-47a4-8e8a-d955b0a8db79 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:28.031775 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c3f38e27-43f7-47a4-8e8a-d955b0a8db79 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:28.231665 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-c3f38e27-43f7-47a4-8e8a-d955b0a8db79 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:28.245437 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-c3f38e27-43f7-47a4-8e8a-d955b0a8db79 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:28.251474 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-c3f38e27-43f7-47a4-8e8a-d955b0a8db79 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:28.252554 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-c3f38e27-43f7-47a4-8e8a-d955b0a8db79 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33" status: 200 len: 1740 microversion: 2.20 time: 0.240875 Apr 08 02:54:28.253076 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 428/852] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:54:28 2022] GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33 => generated 1740 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:54:28.560133 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-6a97aba9-616a-406d-9f4c-9ac9d1eea14e tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1211889029"}} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:54:28.560670 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-6a97aba9-616a-406d-9f4c-9ac9d1eea14e tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] [instance: dac91570-d62d-4a3c-a83c-20a727657c9d] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:28.567707 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-6a97aba9-616a-406d-9f4c-9ac9d1eea14e tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:28.568140 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-6a97aba9-616a-406d-9f4c-9ac9d1eea14e tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:28.568888 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-6a97aba9-616a-406d-9f4c-9ac9d1eea14e tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:28.569340 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-6a97aba9-616a-406d-9f4c-9ac9d1eea14e tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:28.762739 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.network.security_group_api [None req-6a97aba9-616a-406d-9f4c-9ac9d1eea14e tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Removing security group e7f5e98b-b52c-4ae3-83e9-21cfe12d42de from port f7bd9446-7011-458c-94be-2eb73cc73b68 Apr 08 02:54:29.276755 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-46fe537a-5019-4989-8c60-c47f0dba032e tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:29.277433 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-46fe537a-5019-4989-8c60-c47f0dba032e tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: bbeb7a47-a8ee-44b3-bc79-bd12670aaa33] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:29.285310 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-46fe537a-5019-4989-8c60-c47f0dba032e tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:29.286083 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-46fe537a-5019-4989-8c60-c47f0dba032e tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:29.287079 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-46fe537a-5019-4989-8c60-c47f0dba032e tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:29.287709 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-46fe537a-5019-4989-8c60-c47f0dba032e tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:29.339953 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-6a97aba9-616a-406d-9f4c-9ac9d1eea14e tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] 10.222.0.48 "POST /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d/action" status: 202 len: 0 microversion: 2.1 time: 0.788836 Apr 08 02:54:29.340643 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 425/853] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Apr 8 02:54:28 2022] POST /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d/action => generated 0 bytes in 790 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 02:54:29.362724 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [req-97ca279f-a802-4907-af76-876b2f97a623 req-f063184c-7d3e-4d03-82f9-b6b737734915 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dac91570-d62d-4a3c-a83c-20a727657c9d", "tag": "f7bd9446-7011-458c-94be-2eb73cc73b68"}]} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:54:29.384482 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:54:29.384482 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: warnings.warn(msg) Apr 08 02:54:29.411478 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-97ca279f-a802-4907-af76-876b2f97a623 req-f063184c-7d3e-4d03-82f9-b6b737734915 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:29.411920 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-97ca279f-a802-4907-af76-876b2f97a623 req-f063184c-7d3e-4d03-82f9-b6b737734915 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:29.439524 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.compute.server_external_events [req-97ca279f-a802-4907-af76-876b2f97a623 req-f063184c-7d3e-4d03-82f9-b6b737734915 service nova] Creating event network-changed:f7bd9446-7011-458c-94be-2eb73cc73b68 for instance dac91570-d62d-4a3c-a83c-20a727657c9d on hv-cinder-83705 Apr 08 02:54:29.445782 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [req-97ca279f-a802-4907-af76-876b2f97a623 req-f063184c-7d3e-4d03-82f9-b6b737734915 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101703 Apr 08 02:54:29.446657 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 426/854] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:54:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:54:29.720576 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-46fe537a-5019-4989-8c60-c47f0dba032e tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:29.758695 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-46fe537a-5019-4989-8c60-c47f0dba032e tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:29.767992 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-46fe537a-5019-4989-8c60-c47f0dba032e tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:29.770205 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-46fe537a-5019-4989-8c60-c47f0dba032e tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33" status: 200 len: 1722 microversion: 2.20 time: 0.503269 Apr 08 02:54:29.771785 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 429/855] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:54:29 2022] GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33 => generated 1722 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:54:30.796222 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-778b7b86-d491-4a7a-8adc-b858d6399830 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:30.796838 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-778b7b86-d491-4a7a-8adc-b858d6399830 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: bbeb7a47-a8ee-44b3-bc79-bd12670aaa33] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:30.804527 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-778b7b86-d491-4a7a-8adc-b858d6399830 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:30.805061 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-778b7b86-d491-4a7a-8adc-b858d6399830 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:30.805916 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-778b7b86-d491-4a7a-8adc-b858d6399830 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:30.806421 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-778b7b86-d491-4a7a-8adc-b858d6399830 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:30.855702 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [req-091969c0-41b9-4782-abff-6dda09df93f7 req-24612a46-972a-4642-81dd-e3e1abbcc63c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbeb7a47-a8ee-44b3-bc79-bd12670aaa33", "name": "network-vif-unplugged", "status": "completed", "tag": "2bd62dce-ca58-4c9e-bb8a-99411d102c48"}]} {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:54:30.864691 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:54:30.864691 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: warnings.warn(msg) Apr 08 02:54:30.875391 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-091969c0-41b9-4782-abff-6dda09df93f7 req-24612a46-972a-4642-81dd-e3e1abbcc63c service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:30.876384 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-091969c0-41b9-4782-abff-6dda09df93f7 req-24612a46-972a-4642-81dd-e3e1abbcc63c service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:30.895643 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.compute.server_external_events [req-091969c0-41b9-4782-abff-6dda09df93f7 req-24612a46-972a-4642-81dd-e3e1abbcc63c service nova] Creating event network-vif-unplugged:2bd62dce-ca58-4c9e-bb8a-99411d102c48 for instance bbeb7a47-a8ee-44b3-bc79-bd12670aaa33 on hv-cinder-83705 Apr 08 02:54:30.901579 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [req-091969c0-41b9-4782-abff-6dda09df93f7 req-24612a46-972a-4642-81dd-e3e1abbcc63c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061339 Apr 08 02:54:30.902372 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 430/856] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:54:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 02:54:31.115208 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-778b7b86-d491-4a7a-8adc-b858d6399830 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:31.129772 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-778b7b86-d491-4a7a-8adc-b858d6399830 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:31.136787 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-778b7b86-d491-4a7a-8adc-b858d6399830 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:31.138244 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-778b7b86-d491-4a7a-8adc-b858d6399830 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33" status: 200 len: 1722 microversion: 2.20 time: 0.352458 Apr 08 02:54:31.138881 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 427/857] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:54:30 2022] GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33 => generated 1722 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:54:31.408549 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-09f56bf7-a64a-4c84-89e5-369273d77bfe tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:31.409122 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-09f56bf7-a64a-4c84-89e5-369273d77bfe tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] [instance: dac91570-d62d-4a3c-a83c-20a727657c9d] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:31.417381 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-09f56bf7-a64a-4c84-89e5-369273d77bfe tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:31.417820 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-09f56bf7-a64a-4c84-89e5-369273d77bfe tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:31.418585 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-09f56bf7-a64a-4c84-89e5-369273d77bfe tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:31.419042 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-09f56bf7-a64a-4c84-89e5-369273d77bfe tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:31.516877 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [req-7be6a49e-d7a7-4a97-a8a4-6da98309bc83 req-745ca0b6-a5a3-4b4b-9768-4e781c5590a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dac91570-d62d-4a3c-a83c-20a727657c9d", "tag": "f7bd9446-7011-458c-94be-2eb73cc73b68"}]} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:54:31.526887 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:54:31.526887 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: warnings.warn(msg) Apr 08 02:54:31.535635 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-7be6a49e-d7a7-4a97-a8a4-6da98309bc83 req-745ca0b6-a5a3-4b4b-9768-4e781c5590a2 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:31.536156 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-7be6a49e-d7a7-4a97-a8a4-6da98309bc83 req-745ca0b6-a5a3-4b4b-9768-4e781c5590a2 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:31.553102 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.compute.server_external_events [req-7be6a49e-d7a7-4a97-a8a4-6da98309bc83 req-745ca0b6-a5a3-4b4b-9768-4e781c5590a2 service nova] Creating event network-changed:f7bd9446-7011-458c-94be-2eb73cc73b68 for instance dac91570-d62d-4a3c-a83c-20a727657c9d on hv-cinder-83705 Apr 08 02:54:31.558711 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [req-7be6a49e-d7a7-4a97-a8a4-6da98309bc83 req-745ca0b6-a5a3-4b4b-9768-4e781c5590a2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052724 Apr 08 02:54:31.561754 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 428/858] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:54:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 02:54:31.697781 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-09f56bf7-a64a-4c84-89e5-369273d77bfe tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] 10.222.0.48 "DELETE /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d/os-volume_attachments/5a599254-d271-48f0-bf67-3275b6894a86" status: 202 len: 0 microversion: 2.1 time: 0.298950 Apr 08 02:54:31.702974 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 431/859] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Apr 8 02:54:31 2022] DELETE /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d/os-volume_attachments/5a599254-d271-48f0-bf67-3275b6894a86 => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 02:54:31.725018 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-393a8faf-9c10-462c-840d-fbef76d091db tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:31.727564 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-393a8faf-9c10-462c-840d-fbef76d091db tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] [instance: dac91570-d62d-4a3c-a83c-20a727657c9d] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:31.738392 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-393a8faf-9c10-462c-840d-fbef76d091db tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:31.739139 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-393a8faf-9c10-462c-840d-fbef76d091db tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:31.740074 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-393a8faf-9c10-462c-840d-fbef76d091db tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:31.740662 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-393a8faf-9c10-462c-840d-fbef76d091db tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:31.816147 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-393a8faf-9c10-462c-840d-fbef76d091db tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] 10.222.0.48 "GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107630 Apr 08 02:54:31.817064 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 429/860] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Apr 8 02:54:31 2022] GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:54:32.161799 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-ec35d493-9a82-4e1f-a048-f4b250647c88 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:32.163653 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-ec35d493-9a82-4e1f-a048-f4b250647c88 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: bbeb7a47-a8ee-44b3-bc79-bd12670aaa33] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:32.171225 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-ec35d493-9a82-4e1f-a048-f4b250647c88 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:32.171675 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-ec35d493-9a82-4e1f-a048-f4b250647c88 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:32.172462 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-ec35d493-9a82-4e1f-a048-f4b250647c88 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:32.172872 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-ec35d493-9a82-4e1f-a048-f4b250647c88 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:32.547436 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-ec35d493-9a82-4e1f-a048-f4b250647c88 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:32.560508 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-ec35d493-9a82-4e1f-a048-f4b250647c88 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:32.566485 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-ec35d493-9a82-4e1f-a048-f4b250647c88 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:32.567590 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-ec35d493-9a82-4e1f-a048-f4b250647c88 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33" status: 200 len: 1665 microversion: 2.20 time: 0.415288 Apr 08 02:54:32.568112 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 432/861] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:54:32 2022] GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33 => generated 1665 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 02:54:32.591345 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-1299b80c-501e-4c52-b38e-54a627355265 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "11025722-c208-4f60-a7e6-d8e41e7f597f"}} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:54:32.592389 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-1299b80c-501e-4c52-b38e-54a627355265 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: bbeb7a47-a8ee-44b3-bc79-bd12670aaa33] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:32.599461 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-1299b80c-501e-4c52-b38e-54a627355265 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:32.599909 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-1299b80c-501e-4c52-b38e-54a627355265 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:32.601332 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-1299b80c-501e-4c52-b38e-54a627355265 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:32.601842 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-1299b80c-501e-4c52-b38e-54a627355265 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:32.832703 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-82276ad7-b4af-4319-9658-209db55dd01c tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:32.833680 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-82276ad7-b4af-4319-9658-209db55dd01c tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] [instance: dac91570-d62d-4a3c-a83c-20a727657c9d] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:32.842517 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-82276ad7-b4af-4319-9658-209db55dd01c tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:32.842991 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-82276ad7-b4af-4319-9658-209db55dd01c tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:32.843761 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-82276ad7-b4af-4319-9658-209db55dd01c tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:32.844213 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-82276ad7-b4af-4319-9658-209db55dd01c tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:32.913587 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-82276ad7-b4af-4319-9658-209db55dd01c tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] 10.222.0.48 "GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.089193 Apr 08 02:54:32.914630 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 433/862] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Apr 8 02:54:32 2022] GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d/os-volume_attachments => generated 25 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 08 02:54:32.930245 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-8e413cb4-8c1f-4fba-96b8-ac3fb794f6a4 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:32.930770 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-8e413cb4-8c1f-4fba-96b8-ac3fb794f6a4 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] [instance: dac91570-d62d-4a3c-a83c-20a727657c9d] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:32.937896 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-8e413cb4-8c1f-4fba-96b8-ac3fb794f6a4 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:32.938344 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-8e413cb4-8c1f-4fba-96b8-ac3fb794f6a4 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:32.939157 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-8e413cb4-8c1f-4fba-96b8-ac3fb794f6a4 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:32.939588 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-8e413cb4-8c1f-4fba-96b8-ac3fb794f6a4 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:33.026345 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-1299b80c-501e-4c52-b38e-54a627355265 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "POST /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.444761 Apr 08 02:54:33.027167 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 430/863] 10.222.0.48 () {62 vars in 1363 bytes} [Fri Apr 8 02:54:32 2022] POST /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33/os-volume_attachments => generated 188 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 08 02:54:33.095181 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.wsgi [None req-8e413cb4-8c1f-4fba-96b8-ac3fb794f6a4 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] HTTP exception thrown: Instance dac91570-d62d-4a3c-a83c-20a727657c9d is not attached to volume 5a599254-d271-48f0-bf67-3275b6894a86 Apr 08 02:54:33.095778 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-8e413cb4-8c1f-4fba-96b8-ac3fb794f6a4 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Returning 404 to user: Instance dac91570-d62d-4a3c-a83c-20a727657c9d is not attached to volume 5a599254-d271-48f0-bf67-3275b6894a86 {{(pid=96920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Apr 08 02:54:33.096587 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-8e413cb4-8c1f-4fba-96b8-ac3fb794f6a4 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] 10.222.0.48 "DELETE /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d/os-volume_attachments/5a599254-d271-48f0-bf67-3275b6894a86" status: 404 len: 154 microversion: 2.1 time: 0.176394 Apr 08 02:54:33.097118 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 434/864] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Apr 8 02:54:32 2022] DELETE /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d/os-volume_attachments/5a599254-d271-48f0-bf67-3275b6894a86 => generated 154 bytes in 177 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 08 02:54:33.209688 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-9bbc6308-02a8-457c-980b-9db44cb0e314 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:33.211016 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-9bbc6308-02a8-457c-980b-9db44cb0e314 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: bbeb7a47-a8ee-44b3-bc79-bd12670aaa33] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:33.230231 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-9bbc6308-02a8-457c-980b-9db44cb0e314 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:33.230760 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-9bbc6308-02a8-457c-980b-9db44cb0e314 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:33.231747 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-9bbc6308-02a8-457c-980b-9db44cb0e314 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:33.232345 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-9bbc6308-02a8-457c-980b-9db44cb0e314 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:33.811859 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-9bbc6308-02a8-457c-980b-9db44cb0e314 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "DELETE /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33/os-volume_attachments/11025722-c208-4f60-a7e6-d8e41e7f597f" status: 202 len: 0 microversion: 2.20 time: 0.611737 Apr 08 02:54:33.812428 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 431/865] 10.222.0.48 () {60 vars in 1456 bytes} [Fri Apr 8 02:54:33 2022] DELETE /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33/os-volume_attachments/11025722-c208-4f60-a7e6-d8e41e7f597f => generated 0 bytes in 613 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 08 02:54:33.903034 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-eaf953f1-149d-4060-bf82-e7172f6f69c3 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:54:33.903593 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-eaf953f1-149d-4060-bf82-e7172f6f69c3 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: bbeb7a47-a8ee-44b3-bc79-bd12670aaa33] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:33.910777 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-eaf953f1-149d-4060-bf82-e7172f6f69c3 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:33.911224 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-eaf953f1-149d-4060-bf82-e7172f6f69c3 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:33.911977 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-eaf953f1-149d-4060-bf82-e7172f6f69c3 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:33.912402 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-eaf953f1-149d-4060-bf82-e7172f6f69c3 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:34.132523 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-eaf953f1-149d-4060-bf82-e7172f6f69c3 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "POST /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33/action" status: 202 len: 0 microversion: 2.20 time: 0.238068 Apr 08 02:54:34.133096 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 435/866] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Apr 8 02:54:33 2022] POST /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 08 02:54:34.146681 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-9a16c68b-a8dd-46f9-9976-8ace26596ec9 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:34.148437 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-9a16c68b-a8dd-46f9-9976-8ace26596ec9 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: bbeb7a47-a8ee-44b3-bc79-bd12670aaa33] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:34.155217 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-9a16c68b-a8dd-46f9-9976-8ace26596ec9 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:34.155657 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-9a16c68b-a8dd-46f9-9976-8ace26596ec9 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:34.156425 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-9a16c68b-a8dd-46f9-9976-8ace26596ec9 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:34.156926 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-9a16c68b-a8dd-46f9-9976-8ace26596ec9 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:34.345959 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-a611fc0b-9112-482a-81a0-abf142e454ac tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:34.346450 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-a611fc0b-9112-482a-81a0-abf142e454ac tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] [instance: dac91570-d62d-4a3c-a83c-20a727657c9d] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:34.353714 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-a611fc0b-9112-482a-81a0-abf142e454ac tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:34.354162 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-a611fc0b-9112-482a-81a0-abf142e454ac tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:34.354961 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-a611fc0b-9112-482a-81a0-abf142e454ac tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:34.355392 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-a611fc0b-9112-482a-81a0-abf142e454ac tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:34.385552 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-9a16c68b-a8dd-46f9-9976-8ace26596ec9 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:34.401485 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-9a16c68b-a8dd-46f9-9976-8ace26596ec9 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:34.409823 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-9a16c68b-a8dd-46f9-9976-8ace26596ec9 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:34.411146 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-9a16c68b-a8dd-46f9-9976-8ace26596ec9 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33" status: 200 len: 1673 microversion: 2.20 time: 0.273829 Apr 08 02:54:34.411979 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 432/867] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:54:34 2022] GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33 => generated 1673 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 02:54:34.424871 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-a611fc0b-9112-482a-81a0-abf142e454ac tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] [instance: dac91570-d62d-4a3c-a83c-20a727657c9d] Going to try to terminate instance {{(pid=96920) delete /opt/stack/nova/nova/compute/api.py:2559}} Apr 08 02:54:34.540449 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-a611fc0b-9112-482a-81a0-abf142e454ac tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] 10.222.0.48 "DELETE /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d" status: 204 len: 0 microversion: 2.1 time: 0.203377 Apr 08 02:54:34.541109 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 436/868] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Apr 8 02:54:34 2022] DELETE /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 08 02:54:34.555433 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-84301e9e-f964-4caa-992a-0ccf0831d971 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:34.555963 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-84301e9e-f964-4caa-992a-0ccf0831d971 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] [instance: dac91570-d62d-4a3c-a83c-20a727657c9d] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:34.563082 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-84301e9e-f964-4caa-992a-0ccf0831d971 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:34.563521 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-84301e9e-f964-4caa-992a-0ccf0831d971 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:34.564298 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-84301e9e-f964-4caa-992a-0ccf0831d971 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:34.564702 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-84301e9e-f964-4caa-992a-0ccf0831d971 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:34.815563 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-84301e9e-f964-4caa-992a-0ccf0831d971 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b08a414e0c45ab839107cccb69f179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb5fe9c67d048c5b2097f9a923ac025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:34.823890 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-84301e9e-f964-4caa-992a-0ccf0831d971 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] 10.222.0.48 "GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d" status: 200 len: 1555 microversion: 2.1 time: 0.278455 Apr 08 02:54:34.824705 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 433/869] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:54:34 2022] GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d => generated 1555 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:54:35.439579 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-7c7fae6a-5c54-4e6c-aff0-fa8230aa4ac7 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:35.440204 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-7c7fae6a-5c54-4e6c-aff0-fa8230aa4ac7 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: bbeb7a47-a8ee-44b3-bc79-bd12670aaa33] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:35.447406 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-7c7fae6a-5c54-4e6c-aff0-fa8230aa4ac7 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:35.447845 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-7c7fae6a-5c54-4e6c-aff0-fa8230aa4ac7 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:35.448616 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-7c7fae6a-5c54-4e6c-aff0-fa8230aa4ac7 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:35.449048 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-7c7fae6a-5c54-4e6c-aff0-fa8230aa4ac7 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:35.828596 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-7c7fae6a-5c54-4e6c-aff0-fa8230aa4ac7 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:35.843098 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-7c7fae6a-5c54-4e6c-aff0-fa8230aa4ac7 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:35.847248 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-89e6e8e7-36ec-42cd-af09-766035df252b tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:35.847849 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-89e6e8e7-36ec-42cd-af09-766035df252b tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] [instance: dac91570-d62d-4a3c-a83c-20a727657c9d] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:35.849104 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-7c7fae6a-5c54-4e6c-aff0-fa8230aa4ac7 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:35.850226 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-7c7fae6a-5c54-4e6c-aff0-fa8230aa4ac7 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33" status: 200 len: 1675 microversion: 2.20 time: 0.423254 Apr 08 02:54:35.851322 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 437/870] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:54:35 2022] GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33 => generated 1675 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:54:35.855857 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-89e6e8e7-36ec-42cd-af09-766035df252b tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:35.856295 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-89e6e8e7-36ec-42cd-af09-766035df252b tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:35.857060 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-89e6e8e7-36ec-42cd-af09-766035df252b tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:35.857568 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-89e6e8e7-36ec-42cd-af09-766035df252b tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:36.082552 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-89e6e8e7-36ec-42cd-af09-766035df252b tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b08a414e0c45ab839107cccb69f179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb5fe9c67d048c5b2097f9a923ac025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:36.091822 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-89e6e8e7-36ec-42cd-af09-766035df252b tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] 10.222.0.48 "GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d" status: 200 len: 1555 microversion: 2.1 time: 0.253772 Apr 08 02:54:36.092355 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 434/871] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:54:35 2022] GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d => generated 1555 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:54:36.874676 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-fed75ead-8629-4024-a748-92799702329d tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:36.875263 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-fed75ead-8629-4024-a748-92799702329d tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: bbeb7a47-a8ee-44b3-bc79-bd12670aaa33] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:36.883554 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-fed75ead-8629-4024-a748-92799702329d tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:36.884006 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-fed75ead-8629-4024-a748-92799702329d tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:36.884789 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-fed75ead-8629-4024-a748-92799702329d tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:36.885221 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-fed75ead-8629-4024-a748-92799702329d tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:37.100964 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-fed75ead-8629-4024-a748-92799702329d tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:37.114731 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-ef3518cd-4e25-473b-ae95-ae182887d723 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:37.115340 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-ef3518cd-4e25-473b-ae95-ae182887d723 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] [instance: dac91570-d62d-4a3c-a83c-20a727657c9d] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:37.115486 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-fed75ead-8629-4024-a748-92799702329d tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:37.122153 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-fed75ead-8629-4024-a748-92799702329d tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:37.123096 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ef3518cd-4e25-473b-ae95-ae182887d723 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:37.123318 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-fed75ead-8629-4024-a748-92799702329d tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33" status: 200 len: 1731 microversion: 2.20 time: 0.258142 Apr 08 02:54:37.123867 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ef3518cd-4e25-473b-ae95-ae182887d723 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:37.124154 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 438/872] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:54:36 2022] GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33 => generated 1731 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:54:37.125187 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ef3518cd-4e25-473b-ae95-ae182887d723 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:37.125568 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ef3518cd-4e25-473b-ae95-ae182887d723 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:37.331603 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-ef3518cd-4e25-473b-ae95-ae182887d723 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b08a414e0c45ab839107cccb69f179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb5fe9c67d048c5b2097f9a923ac025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:37.340668 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-ef3518cd-4e25-473b-ae95-ae182887d723 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] 10.222.0.48 "GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d" status: 200 len: 1555 microversion: 2.1 time: 0.235482 Apr 08 02:54:37.341216 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 435/873] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:54:37 2022] GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d => generated 1555 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:54:38.147463 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-716ff3fc-6a49-4bbf-8eb3-23c1189649cb tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:38.148089 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-716ff3fc-6a49-4bbf-8eb3-23c1189649cb tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: bbeb7a47-a8ee-44b3-bc79-bd12670aaa33] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:38.155356 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-716ff3fc-6a49-4bbf-8eb3-23c1189649cb tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:38.155800 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-716ff3fc-6a49-4bbf-8eb3-23c1189649cb tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:38.156571 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-716ff3fc-6a49-4bbf-8eb3-23c1189649cb tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:38.156998 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-716ff3fc-6a49-4bbf-8eb3-23c1189649cb tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:38.366060 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-a4aa004b-f52c-44eb-9254-65fbf9770bad tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:38.366781 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-a4aa004b-f52c-44eb-9254-65fbf9770bad tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] [instance: dac91570-d62d-4a3c-a83c-20a727657c9d] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:38.368487 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-716ff3fc-6a49-4bbf-8eb3-23c1189649cb tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:38.374411 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-a4aa004b-f52c-44eb-9254-65fbf9770bad tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:38.374890 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-a4aa004b-f52c-44eb-9254-65fbf9770bad tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:38.375657 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-a4aa004b-f52c-44eb-9254-65fbf9770bad tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:38.376082 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-a4aa004b-f52c-44eb-9254-65fbf9770bad tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:38.382453 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-716ff3fc-6a49-4bbf-8eb3-23c1189649cb tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:38.388764 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-716ff3fc-6a49-4bbf-8eb3-23c1189649cb tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:38.389888 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-716ff3fc-6a49-4bbf-8eb3-23c1189649cb tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33" status: 200 len: 1731 microversion: 2.20 time: 0.251501 Apr 08 02:54:38.390410 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 439/874] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:54:38 2022] GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33 => generated 1731 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:54:38.590085 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-a4aa004b-f52c-44eb-9254-65fbf9770bad tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b08a414e0c45ab839107cccb69f179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb5fe9c67d048c5b2097f9a923ac025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:38.598517 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-a4aa004b-f52c-44eb-9254-65fbf9770bad tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] 10.222.0.48 "GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d" status: 200 len: 1555 microversion: 2.1 time: 0.244824 Apr 08 02:54:38.599309 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 436/875] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:54:38 2022] GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d => generated 1555 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:54:39.414975 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-3fbd5e16-1e1c-47d6-95d2-0cac6338c5dd tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:39.415673 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-3fbd5e16-1e1c-47d6-95d2-0cac6338c5dd tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: bbeb7a47-a8ee-44b3-bc79-bd12670aaa33] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:39.422903 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-3fbd5e16-1e1c-47d6-95d2-0cac6338c5dd tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:39.423347 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-3fbd5e16-1e1c-47d6-95d2-0cac6338c5dd tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:39.424121 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-3fbd5e16-1e1c-47d6-95d2-0cac6338c5dd tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:39.424557 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-3fbd5e16-1e1c-47d6-95d2-0cac6338c5dd tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:39.622495 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-5d46ccff-0bdc-40cf-a231-bd3f79002dbe tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:39.624153 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-5d46ccff-0bdc-40cf-a231-bd3f79002dbe tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] [instance: dac91570-d62d-4a3c-a83c-20a727657c9d] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:39.632591 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-5d46ccff-0bdc-40cf-a231-bd3f79002dbe tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:39.633126 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-5d46ccff-0bdc-40cf-a231-bd3f79002dbe tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:39.633986 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-5d46ccff-0bdc-40cf-a231-bd3f79002dbe tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:39.634490 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-5d46ccff-0bdc-40cf-a231-bd3f79002dbe tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:39.700377 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-3fbd5e16-1e1c-47d6-95d2-0cac6338c5dd tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:39.714409 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-3fbd5e16-1e1c-47d6-95d2-0cac6338c5dd tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:39.720401 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-3fbd5e16-1e1c-47d6-95d2-0cac6338c5dd tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:39.721499 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-3fbd5e16-1e1c-47d6-95d2-0cac6338c5dd tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33" status: 200 len: 1731 microversion: 2.20 time: 0.316072 Apr 08 02:54:39.722020 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 440/876] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:54:39 2022] GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33 => generated 1731 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:54:39.941272 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-5d46ccff-0bdc-40cf-a231-bd3f79002dbe tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b08a414e0c45ab839107cccb69f179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb5fe9c67d048c5b2097f9a923ac025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:39.949572 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-5d46ccff-0bdc-40cf-a231-bd3f79002dbe tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] 10.222.0.48 "GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d" status: 200 len: 1555 microversion: 2.1 time: 0.337068 Apr 08 02:54:39.950022 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 437/877] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:54:39 2022] GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d => generated 1555 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:54:40.753082 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-a2f32b1b-4160-471a-9989-5891283affaf tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:40.753722 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-a2f32b1b-4160-471a-9989-5891283affaf tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: bbeb7a47-a8ee-44b3-bc79-bd12670aaa33] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:40.762105 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-a2f32b1b-4160-471a-9989-5891283affaf tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:40.762825 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-a2f32b1b-4160-471a-9989-5891283affaf tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:40.763594 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-a2f32b1b-4160-471a-9989-5891283affaf tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:40.764014 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-a2f32b1b-4160-471a-9989-5891283affaf tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:40.909838 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [req-fc764ea2-49fc-4db0-8ee0-3b2c83cd1c5d req-4ae76c2f-4973-4c7a-8064-0a843a684446 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dac91570-d62d-4a3c-a83c-20a727657c9d", "name": "network-vif-unplugged", "status": "completed", "tag": "f7bd9446-7011-458c-94be-2eb73cc73b68"}]} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:54:40.920455 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:54:40.920455 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: warnings.warn(msg) Apr 08 02:54:40.947847 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-fc764ea2-49fc-4db0-8ee0-3b2c83cd1c5d req-4ae76c2f-4973-4c7a-8064-0a843a684446 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:40.948280 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-fc764ea2-49fc-4db0-8ee0-3b2c83cd1c5d req-4ae76c2f-4973-4c7a-8064-0a843a684446 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:40.979643 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.compute.server_external_events [req-fc764ea2-49fc-4db0-8ee0-3b2c83cd1c5d req-4ae76c2f-4973-4c7a-8064-0a843a684446 service nova] Creating event network-vif-unplugged:f7bd9446-7011-458c-94be-2eb73cc73b68 for instance dac91570-d62d-4a3c-a83c-20a727657c9d on hv-cinder-83705 Apr 08 02:54:40.996211 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-a2f32b1b-4160-471a-9989-5891283affaf tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:40.996605 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [req-fc764ea2-49fc-4db0-8ee0-3b2c83cd1c5d req-4ae76c2f-4973-4c7a-8064-0a843a684446 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097509 Apr 08 02:54:40.997195 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 438/878] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:54:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 02:54:41.008749 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-eb6ef338-fe40-48c8-b93b-3aa005312932 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:41.009445 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-eb6ef338-fe40-48c8-b93b-3aa005312932 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] [instance: dac91570-d62d-4a3c-a83c-20a727657c9d] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:41.017429 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-eb6ef338-fe40-48c8-b93b-3aa005312932 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:41.017881 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-eb6ef338-fe40-48c8-b93b-3aa005312932 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:41.018682 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-eb6ef338-fe40-48c8-b93b-3aa005312932 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:41.019450 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-eb6ef338-fe40-48c8-b93b-3aa005312932 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:41.024024 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-a2f32b1b-4160-471a-9989-5891283affaf tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:41.039173 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-a2f32b1b-4160-471a-9989-5891283affaf tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:41.043708 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-a2f32b1b-4160-471a-9989-5891283affaf tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33" status: 200 len: 1731 microversion: 2.20 time: 0.299728 Apr 08 02:54:41.044442 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 441/879] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:54:40 2022] GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33 => generated 1731 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:54:41.233695 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-eb6ef338-fe40-48c8-b93b-3aa005312932 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b08a414e0c45ab839107cccb69f179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb5fe9c67d048c5b2097f9a923ac025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:41.242807 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-eb6ef338-fe40-48c8-b93b-3aa005312932 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] 10.222.0.48 "GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d" status: 200 len: 1555 microversion: 2.1 time: 0.244391 Apr 08 02:54:41.243308 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 439/880] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:54:40 2022] GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d => generated 1555 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:54:42.070544 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-1856dae8-f1f6-44a0-9909-f6de05fa5741 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:42.071164 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-1856dae8-f1f6-44a0-9909-f6de05fa5741 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: bbeb7a47-a8ee-44b3-bc79-bd12670aaa33] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:42.078341 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-1856dae8-f1f6-44a0-9909-f6de05fa5741 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:42.078817 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-1856dae8-f1f6-44a0-9909-f6de05fa5741 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:42.079611 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-1856dae8-f1f6-44a0-9909-f6de05fa5741 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:42.080018 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-1856dae8-f1f6-44a0-9909-f6de05fa5741 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:42.265797 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-2852d0c8-5fa0-4ce3-83bc-de63945c9297 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:42.267137 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-2852d0c8-5fa0-4ce3-83bc-de63945c9297 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] [instance: dac91570-d62d-4a3c-a83c-20a727657c9d] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:42.275008 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-2852d0c8-5fa0-4ce3-83bc-de63945c9297 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:42.275811 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-2852d0c8-5fa0-4ce3-83bc-de63945c9297 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:42.276830 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-2852d0c8-5fa0-4ce3-83bc-de63945c9297 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:42.277481 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-2852d0c8-5fa0-4ce3-83bc-de63945c9297 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:42.299623 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-1856dae8-f1f6-44a0-9909-f6de05fa5741 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:42.315112 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-1856dae8-f1f6-44a0-9909-f6de05fa5741 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:42.323604 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-1856dae8-f1f6-44a0-9909-f6de05fa5741 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:42.324827 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-1856dae8-f1f6-44a0-9909-f6de05fa5741 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33" status: 200 len: 1731 microversion: 2.20 time: 0.265063 Apr 08 02:54:42.329353 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 442/881] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:54:42 2022] GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33 => generated 1731 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:54:42.503799 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-2852d0c8-5fa0-4ce3-83bc-de63945c9297 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b08a414e0c45ab839107cccb69f179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb5fe9c67d048c5b2097f9a923ac025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:42.512145 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-2852d0c8-5fa0-4ce3-83bc-de63945c9297 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] 10.222.0.48 "GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d" status: 200 len: 1555 microversion: 2.1 time: 0.256279 Apr 08 02:54:42.512947 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 440/882] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:54:42 2022] GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d => generated 1555 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:54:43.351174 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-c21173d7-9d7b-4fe2-9171-780b95c4a5fa tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:43.351865 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-c21173d7-9d7b-4fe2-9171-780b95c4a5fa tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: bbeb7a47-a8ee-44b3-bc79-bd12670aaa33] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:43.359210 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c21173d7-9d7b-4fe2-9171-780b95c4a5fa tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:43.359644 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c21173d7-9d7b-4fe2-9171-780b95c4a5fa tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:43.360407 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c21173d7-9d7b-4fe2-9171-780b95c4a5fa tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:43.360828 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c21173d7-9d7b-4fe2-9171-780b95c4a5fa tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:43.534429 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-d5092a35-166d-452d-8c8c-d500be1b68be tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:43.535091 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-d5092a35-166d-452d-8c8c-d500be1b68be tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] [instance: dac91570-d62d-4a3c-a83c-20a727657c9d] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:43.543095 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-d5092a35-166d-452d-8c8c-d500be1b68be tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:43.543670 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-d5092a35-166d-452d-8c8c-d500be1b68be tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:43.544474 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-d5092a35-166d-452d-8c8c-d500be1b68be tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:43.544976 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-d5092a35-166d-452d-8c8c-d500be1b68be tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:43.572689 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-c21173d7-9d7b-4fe2-9171-780b95c4a5fa tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:43.589080 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-c21173d7-9d7b-4fe2-9171-780b95c4a5fa tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:43.595655 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-c21173d7-9d7b-4fe2-9171-780b95c4a5fa tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:43.596926 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-c21173d7-9d7b-4fe2-9171-780b95c4a5fa tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33" status: 200 len: 1731 microversion: 2.20 time: 0.255498 Apr 08 02:54:43.597456 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 443/883] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:54:43 2022] GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33 => generated 1731 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:54:43.752481 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-d5092a35-166d-452d-8c8c-d500be1b68be tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b08a414e0c45ab839107cccb69f179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb5fe9c67d048c5b2097f9a923ac025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:43.762041 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-d5092a35-166d-452d-8c8c-d500be1b68be tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] 10.222.0.48 "GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d" status: 200 len: 1555 microversion: 2.1 time: 0.236547 Apr 08 02:54:43.762856 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 441/884] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:54:43 2022] GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d => generated 1555 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:54:44.622146 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-d3022e0f-3f1f-4fd1-aeb8-38609189b000 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:44.622882 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-d3022e0f-3f1f-4fd1-aeb8-38609189b000 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: bbeb7a47-a8ee-44b3-bc79-bd12670aaa33] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:44.630096 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-d3022e0f-3f1f-4fd1-aeb8-38609189b000 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:44.630536 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-d3022e0f-3f1f-4fd1-aeb8-38609189b000 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:44.631834 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-d3022e0f-3f1f-4fd1-aeb8-38609189b000 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:44.632316 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-d3022e0f-3f1f-4fd1-aeb8-38609189b000 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:44.786337 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-539f2fc7-8b38-465a-a2c7-1402e0ae3742 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:44.787089 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-539f2fc7-8b38-465a-a2c7-1402e0ae3742 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] [instance: dac91570-d62d-4a3c-a83c-20a727657c9d] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:44.794764 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-539f2fc7-8b38-465a-a2c7-1402e0ae3742 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:44.795220 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-539f2fc7-8b38-465a-a2c7-1402e0ae3742 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:44.795981 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-539f2fc7-8b38-465a-a2c7-1402e0ae3742 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:44.796405 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-539f2fc7-8b38-465a-a2c7-1402e0ae3742 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:44.851423 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-d3022e0f-3f1f-4fd1-aeb8-38609189b000 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:44.869703 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-d3022e0f-3f1f-4fd1-aeb8-38609189b000 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:44.878970 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-d3022e0f-3f1f-4fd1-aeb8-38609189b000 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:44.880039 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-d3022e0f-3f1f-4fd1-aeb8-38609189b000 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33" status: 200 len: 1731 microversion: 2.20 time: 0.267845 Apr 08 02:54:44.880860 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 444/885] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:54:44 2022] GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33 => generated 1731 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:54:45.016390 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-539f2fc7-8b38-465a-a2c7-1402e0ae3742 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b08a414e0c45ab839107cccb69f179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb5fe9c67d048c5b2097f9a923ac025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:45.025746 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-539f2fc7-8b38-465a-a2c7-1402e0ae3742 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] 10.222.0.48 "GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d" status: 200 len: 1555 microversion: 2.1 time: 0.250152 Apr 08 02:54:45.026490 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 442/886] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:54:44 2022] GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d => generated 1555 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:54:45.905439 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-0f70c4dd-4956-4702-ba8f-5b1df25f69e0 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:45.906066 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-0f70c4dd-4956-4702-ba8f-5b1df25f69e0 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: bbeb7a47-a8ee-44b3-bc79-bd12670aaa33] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:45.914297 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-0f70c4dd-4956-4702-ba8f-5b1df25f69e0 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:45.914771 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-0f70c4dd-4956-4702-ba8f-5b1df25f69e0 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:45.915548 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-0f70c4dd-4956-4702-ba8f-5b1df25f69e0 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:45.915975 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-0f70c4dd-4956-4702-ba8f-5b1df25f69e0 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:46.049684 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-bb11b9a2-2968-49c6-a895-53ec34656e9e tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:46.051073 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-bb11b9a2-2968-49c6-a895-53ec34656e9e tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] [instance: dac91570-d62d-4a3c-a83c-20a727657c9d] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:46.059048 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-bb11b9a2-2968-49c6-a895-53ec34656e9e tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:46.059532 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-bb11b9a2-2968-49c6-a895-53ec34656e9e tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:46.060504 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-bb11b9a2-2968-49c6-a895-53ec34656e9e tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:46.061628 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-bb11b9a2-2968-49c6-a895-53ec34656e9e tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:46.145106 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-0f70c4dd-4956-4702-ba8f-5b1df25f69e0 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:46.164050 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-0f70c4dd-4956-4702-ba8f-5b1df25f69e0 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:46.171350 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-0f70c4dd-4956-4702-ba8f-5b1df25f69e0 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:46.172483 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-0f70c4dd-4956-4702-ba8f-5b1df25f69e0 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33" status: 200 len: 1731 microversion: 2.20 time: 0.276958 Apr 08 02:54:46.185628 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 445/887] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:54:45 2022] GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33 => generated 1731 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:54:46.276842 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-bb11b9a2-2968-49c6-a895-53ec34656e9e tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b08a414e0c45ab839107cccb69f179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb5fe9c67d048c5b2097f9a923ac025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:46.285496 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-bb11b9a2-2968-49c6-a895-53ec34656e9e tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] 10.222.0.48 "GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d" status: 200 len: 1555 microversion: 2.1 time: 0.245017 Apr 08 02:54:46.286231 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 443/888] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:54:46 2022] GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d => generated 1555 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:54:47.198388 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-aae9410c-5e26-425a-a980-5724431b1530 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:47.199027 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-aae9410c-5e26-425a-a980-5724431b1530 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: bbeb7a47-a8ee-44b3-bc79-bd12670aaa33] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:47.206236 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-aae9410c-5e26-425a-a980-5724431b1530 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:47.206705 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-aae9410c-5e26-425a-a980-5724431b1530 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:47.207476 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-aae9410c-5e26-425a-a980-5724431b1530 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:47.207907 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-aae9410c-5e26-425a-a980-5724431b1530 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:47.308668 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-92f26820-57e3-4b37-8b4f-20ab381406af tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:47.309422 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-92f26820-57e3-4b37-8b4f-20ab381406af tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] [instance: dac91570-d62d-4a3c-a83c-20a727657c9d] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:47.316557 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-92f26820-57e3-4b37-8b4f-20ab381406af tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:47.316995 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-92f26820-57e3-4b37-8b4f-20ab381406af tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:47.317781 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-92f26820-57e3-4b37-8b4f-20ab381406af tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:47.318206 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-92f26820-57e3-4b37-8b4f-20ab381406af tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:47.451771 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-aae9410c-5e26-425a-a980-5724431b1530 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:47.465551 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-aae9410c-5e26-425a-a980-5724431b1530 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:47.471610 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-aae9410c-5e26-425a-a980-5724431b1530 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:47.472716 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-aae9410c-5e26-425a-a980-5724431b1530 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33" status: 200 len: 1731 microversion: 2.20 time: 0.283873 Apr 08 02:54:47.473245 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 446/889] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:54:47 2022] GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33 => generated 1731 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 02:54:47.530884 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-92f26820-57e3-4b37-8b4f-20ab381406af tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b08a414e0c45ab839107cccb69f179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb5fe9c67d048c5b2097f9a923ac025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:47.540053 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-92f26820-57e3-4b37-8b4f-20ab381406af tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] 10.222.0.48 "GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d" status: 200 len: 1555 microversion: 2.1 time: 0.240515 Apr 08 02:54:47.540590 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 444/890] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:54:47 2022] GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d => generated 1555 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:54:48.497224 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-56884bb6-8e21-47ab-a058-12de29cbb12c tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:48.497844 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-56884bb6-8e21-47ab-a058-12de29cbb12c tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: bbeb7a47-a8ee-44b3-bc79-bd12670aaa33] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:48.505126 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-56884bb6-8e21-47ab-a058-12de29cbb12c tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:48.505566 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-56884bb6-8e21-47ab-a058-12de29cbb12c tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:48.506865 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-56884bb6-8e21-47ab-a058-12de29cbb12c tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:48.507292 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-56884bb6-8e21-47ab-a058-12de29cbb12c tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:48.562047 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-f9e8076c-46bb-4dbe-84d7-02b526d0c415 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:48.562645 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-f9e8076c-46bb-4dbe-84d7-02b526d0c415 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] [instance: dac91570-d62d-4a3c-a83c-20a727657c9d] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:48.570273 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-f9e8076c-46bb-4dbe-84d7-02b526d0c415 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:48.570746 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-f9e8076c-46bb-4dbe-84d7-02b526d0c415 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:48.571515 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-f9e8076c-46bb-4dbe-84d7-02b526d0c415 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:48.571943 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-f9e8076c-46bb-4dbe-84d7-02b526d0c415 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:48.765806 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-56884bb6-8e21-47ab-a058-12de29cbb12c tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:48.779588 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-56884bb6-8e21-47ab-a058-12de29cbb12c tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:48.785624 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-56884bb6-8e21-47ab-a058-12de29cbb12c tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:48.786742 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-56884bb6-8e21-47ab-a058-12de29cbb12c tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33" status: 200 len: 1731 microversion: 2.20 time: 0.298602 Apr 08 02:54:48.787268 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 447/891] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:54:48 2022] GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33 => generated 1731 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:54:48.822507 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-f9e8076c-46bb-4dbe-84d7-02b526d0c415 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b08a414e0c45ab839107cccb69f179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb5fe9c67d048c5b2097f9a923ac025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:48.830449 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-f9e8076c-46bb-4dbe-84d7-02b526d0c415 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] 10.222.0.48 "GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d" status: 200 len: 1555 microversion: 2.1 time: 0.277406 Apr 08 02:54:48.831011 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 445/892] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:54:48 2022] GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d => generated 1555 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:54:49.852884 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-72debbb0-cfc4-4b44-96f2-05c084e6720b tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:49.853526 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-72debbb0-cfc4-4b44-96f2-05c084e6720b tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] [instance: dac91570-d62d-4a3c-a83c-20a727657c9d] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:49.860464 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-72debbb0-cfc4-4b44-96f2-05c084e6720b tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:49.860900 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-72debbb0-cfc4-4b44-96f2-05c084e6720b tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:49.861659 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-72debbb0-cfc4-4b44-96f2-05c084e6720b tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:49.862081 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-72debbb0-cfc4-4b44-96f2-05c084e6720b tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:49.982931 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-f1a662fb-74d7-4c14-9668-cf5863344ead tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:49.983583 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-f1a662fb-74d7-4c14-9668-cf5863344ead tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: bbeb7a47-a8ee-44b3-bc79-bd12670aaa33] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:49.991236 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-f1a662fb-74d7-4c14-9668-cf5863344ead tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:49.991641 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-f1a662fb-74d7-4c14-9668-cf5863344ead tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:49.992661 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-f1a662fb-74d7-4c14-9668-cf5863344ead tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:49.993039 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-f1a662fb-74d7-4c14-9668-cf5863344ead tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:50.075131 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-72debbb0-cfc4-4b44-96f2-05c084e6720b tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b08a414e0c45ab839107cccb69f179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb5fe9c67d048c5b2097f9a923ac025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:50.083525 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-72debbb0-cfc4-4b44-96f2-05c084e6720b tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] 10.222.0.48 "GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d" status: 200 len: 1555 microversion: 2.1 time: 0.239885 Apr 08 02:54:50.084063 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 446/893] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:54:49 2022] GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d => generated 1555 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:54:50.192586 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-f1a662fb-74d7-4c14-9668-cf5863344ead tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:50.205770 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-f1a662fb-74d7-4c14-9668-cf5863344ead tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:50.212229 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-f1a662fb-74d7-4c14-9668-cf5863344ead tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:50.213353 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-f1a662fb-74d7-4c14-9668-cf5863344ead tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33" status: 200 len: 1731 microversion: 2.20 time: 0.411824 Apr 08 02:54:50.213877 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 448/894] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:54:49 2022] GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33 => generated 1731 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:54:51.106446 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-b0e91e50-a506-426a-850d-719c888a249a tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:51.107094 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-b0e91e50-a506-426a-850d-719c888a249a tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] [instance: dac91570-d62d-4a3c-a83c-20a727657c9d] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:51.114130 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b0e91e50-a506-426a-850d-719c888a249a tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:51.114567 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b0e91e50-a506-426a-850d-719c888a249a tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:51.115363 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b0e91e50-a506-426a-850d-719c888a249a tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:51.115791 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b0e91e50-a506-426a-850d-719c888a249a tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:51.237290 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-a00f1754-a124-4534-9523-ac3a5f68368a tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:51.237865 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-a00f1754-a124-4534-9523-ac3a5f68368a tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: bbeb7a47-a8ee-44b3-bc79-bd12670aaa33] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:51.246715 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-a00f1754-a124-4534-9523-ac3a5f68368a tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:51.246715 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-a00f1754-a124-4534-9523-ac3a5f68368a tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:51.247810 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-a00f1754-a124-4534-9523-ac3a5f68368a tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:51.247931 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-a00f1754-a124-4534-9523-ac3a5f68368a tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:51.323227 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-b0e91e50-a506-426a-850d-719c888a249a tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b08a414e0c45ab839107cccb69f179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb5fe9c67d048c5b2097f9a923ac025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:51.331791 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-b0e91e50-a506-426a-850d-719c888a249a tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] 10.222.0.48 "GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d" status: 200 len: 1555 microversion: 2.1 time: 0.235051 Apr 08 02:54:51.335204 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 447/895] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:54:51 2022] GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d => generated 1555 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:54:51.459751 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-a00f1754-a124-4534-9523-ac3a5f68368a tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:51.473155 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-a00f1754-a124-4534-9523-ac3a5f68368a tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:51.480233 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-a00f1754-a124-4534-9523-ac3a5f68368a tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:51.481372 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-a00f1754-a124-4534-9523-ac3a5f68368a tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33" status: 200 len: 1731 microversion: 2.20 time: 0.253227 Apr 08 02:54:51.482042 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 449/896] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:54:51 2022] GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33 => generated 1731 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 02:54:51.963891 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [req-c379d7ba-fdc6-4a83-944d-f1fa703ac218 req-3c5337fc-9546-49c7-a9d2-e514f634557e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dac91570-d62d-4a3c-a83c-20a727657c9d", "name": "network-vif-deleted", "tag": "f7bd9446-7011-458c-94be-2eb73cc73b68"}]} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:54:51.969934 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:54:51.969934 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: warnings.warn(msg) Apr 08 02:54:51.979303 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-c379d7ba-fdc6-4a83-944d-f1fa703ac218 req-3c5337fc-9546-49c7-a9d2-e514f634557e service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:51.979772 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-c379d7ba-fdc6-4a83-944d-f1fa703ac218 req-3c5337fc-9546-49c7-a9d2-e514f634557e service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:51.999639 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.compute.server_external_events [req-c379d7ba-fdc6-4a83-944d-f1fa703ac218 req-3c5337fc-9546-49c7-a9d2-e514f634557e service nova] Creating event network-vif-deleted:f7bd9446-7011-458c-94be-2eb73cc73b68 for instance dac91570-d62d-4a3c-a83c-20a727657c9d on hv-cinder-83705 Apr 08 02:54:52.005886 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [req-c379d7ba-fdc6-4a83-944d-f1fa703ac218 req-3c5337fc-9546-49c7-a9d2-e514f634557e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052588 Apr 08 02:54:52.007704 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 448/897] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:54:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:54:52.355705 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-001d5ca5-a3e1-4a94-85e0-4aa8ec3f79a7 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:52.356304 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-001d5ca5-a3e1-4a94-85e0-4aa8ec3f79a7 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] [instance: dac91570-d62d-4a3c-a83c-20a727657c9d] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:52.364496 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-001d5ca5-a3e1-4a94-85e0-4aa8ec3f79a7 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:52.364930 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-001d5ca5-a3e1-4a94-85e0-4aa8ec3f79a7 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:52.365817 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-001d5ca5-a3e1-4a94-85e0-4aa8ec3f79a7 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:52.366237 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-001d5ca5-a3e1-4a94-85e0-4aa8ec3f79a7 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:52.441574 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-001d5ca5-a3e1-4a94-85e0-4aa8ec3f79a7 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:52.442376 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-001d5ca5-a3e1-4a94-85e0-4aa8ec3f79a7 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:52.442376 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.objects.instance [None req-001d5ca5-a3e1-4a94-85e0-4aa8ec3f79a7 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lazy-loading 'fault' on Instance uuid dac91570-d62d-4a3c-a83c-20a727657c9d {{(pid=96920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 08 02:54:52.508812 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-9f68213b-a75f-4ea7-bf37-aa1acb1d68fa tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:52.509607 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-9f68213b-a75f-4ea7-bf37-aa1acb1d68fa tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: bbeb7a47-a8ee-44b3-bc79-bd12670aaa33] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:52.519364 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-9f68213b-a75f-4ea7-bf37-aa1acb1d68fa tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:52.519816 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-9f68213b-a75f-4ea7-bf37-aa1acb1d68fa tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:52.520598 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-9f68213b-a75f-4ea7-bf37-aa1acb1d68fa tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:52.521586 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-9f68213b-a75f-4ea7-bf37-aa1acb1d68fa tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:52.583108 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-001d5ca5-a3e1-4a94-85e0-4aa8ec3f79a7 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b08a414e0c45ab839107cccb69f179', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6eb5fe9c67d048c5b2097f9a923ac025', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:52.592516 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-001d5ca5-a3e1-4a94-85e0-4aa8ec3f79a7 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] 10.222.0.48 "GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d" status: 200 len: 1348 microversion: 2.1 time: 0.246896 Apr 08 02:54:52.593469 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 450/898] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:54:52 2022] GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d => generated 1348 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:54:52.734945 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-9f68213b-a75f-4ea7-bf37-aa1acb1d68fa tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:52.748867 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-9f68213b-a75f-4ea7-bf37-aa1acb1d68fa tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:52.755036 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-9f68213b-a75f-4ea7-bf37-aa1acb1d68fa tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:52.756806 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-9f68213b-a75f-4ea7-bf37-aa1acb1d68fa tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33" status: 200 len: 1731 microversion: 2.20 time: 0.258357 Apr 08 02:54:52.757441 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 449/899] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:54:52 2022] GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33 => generated 1731 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 02:54:53.616562 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-3f91bce4-a372-4352-931c-84dc76d6d7d2 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:53.617147 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-3f91bce4-a372-4352-931c-84dc76d6d7d2 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] [instance: dac91570-d62d-4a3c-a83c-20a727657c9d] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:53.624335 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-3f91bce4-a372-4352-931c-84dc76d6d7d2 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:53.624778 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-3f91bce4-a372-4352-931c-84dc76d6d7d2 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:53.625537 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-3f91bce4-a372-4352-931c-84dc76d6d7d2 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:53.625962 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-3f91bce4-a372-4352-931c-84dc76d6d7d2 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:53.677417 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.wsgi [None req-3f91bce4-a372-4352-931c-84dc76d6d7d2 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] HTTP exception thrown: Instance dac91570-d62d-4a3c-a83c-20a727657c9d could not be found. Apr 08 02:54:53.678038 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-3f91bce4-a372-4352-931c-84dc76d6d7d2 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Returning 404 to user: Instance dac91570-d62d-4a3c-a83c-20a727657c9d could not be found. {{(pid=96920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Apr 08 02:54:53.678867 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-3f91bce4-a372-4352-931c-84dc76d6d7d2 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] 10.222.0.48 "GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d" status: 404 len: 111 microversion: 2.1 time: 0.071275 Apr 08 02:54:53.679393 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 451/900] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:54:53 2022] GET /compute/v2.1/servers/dac91570-d62d-4a3c-a83c-20a727657c9d => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 02:54:53.692243 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-89785c92-f6fb-4c6d-bf1d-6991bf7ac1f5 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] Calling method '.version_select at 0x7f7d4e4748b0>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:53.714842 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-89785c92-f6fb-4c6d-bf1d-6991bf7ac1f5 tempest-TestMinimumBasicScenario-1909923347 tempest-TestMinimumBasicScenario-1909923347-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-373052060" status: 202 len: 0 microversion: 2.1 time: 0.031149 Apr 08 02:54:53.715472 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 450/901] 10.222.0.48 () {58 vars in 1268 bytes} [Fri Apr 8 02:54:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-373052060 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 02:54:53.780637 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-7cb7be66-af08-4c74-b256-f37392e2d2e3 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:53.781245 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-7cb7be66-af08-4c74-b256-f37392e2d2e3 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: bbeb7a47-a8ee-44b3-bc79-bd12670aaa33] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:53.789183 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-7cb7be66-af08-4c74-b256-f37392e2d2e3 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:53.790001 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-7cb7be66-af08-4c74-b256-f37392e2d2e3 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:53.790750 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-7cb7be66-af08-4c74-b256-f37392e2d2e3 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:53.791176 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-7cb7be66-af08-4c74-b256-f37392e2d2e3 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:54.018560 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-7cb7be66-af08-4c74-b256-f37392e2d2e3 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:54.033706 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-7cb7be66-af08-4c74-b256-f37392e2d2e3 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:54.040150 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-7cb7be66-af08-4c74-b256-f37392e2d2e3 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:54.041263 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-7cb7be66-af08-4c74-b256-f37392e2d2e3 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33" status: 200 len: 1731 microversion: 2.20 time: 0.270349 Apr 08 02:54:54.041782 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 452/902] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:54:53 2022] GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33 => generated 1731 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:54:55.068668 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-fbe95d32-7e2e-4676-8a57-652092859822 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:55.069335 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-fbe95d32-7e2e-4676-8a57-652092859822 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: bbeb7a47-a8ee-44b3-bc79-bd12670aaa33] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:55.077716 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-fbe95d32-7e2e-4676-8a57-652092859822 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:55.078160 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-fbe95d32-7e2e-4676-8a57-652092859822 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:55.078974 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-fbe95d32-7e2e-4676-8a57-652092859822 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:55.079406 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-fbe95d32-7e2e-4676-8a57-652092859822 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:55.283181 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-fbe95d32-7e2e-4676-8a57-652092859822 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:55.297020 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-fbe95d32-7e2e-4676-8a57-652092859822 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:55.303674 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-fbe95d32-7e2e-4676-8a57-652092859822 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:55.304960 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-fbe95d32-7e2e-4676-8a57-652092859822 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33" status: 200 len: 1731 microversion: 2.20 time: 0.248610 Apr 08 02:54:55.305488 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 451/903] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:54:55 2022] GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33 => generated 1731 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:54:56.328705 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-52fa86e7-ddfd-4fe1-9ed4-b4e005fc03f0 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:56.329335 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-52fa86e7-ddfd-4fe1-9ed4-b4e005fc03f0 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: bbeb7a47-a8ee-44b3-bc79-bd12670aaa33] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:56.336418 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-52fa86e7-ddfd-4fe1-9ed4-b4e005fc03f0 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:56.336860 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-52fa86e7-ddfd-4fe1-9ed4-b4e005fc03f0 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:56.337625 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-52fa86e7-ddfd-4fe1-9ed4-b4e005fc03f0 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:56.338053 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-52fa86e7-ddfd-4fe1-9ed4-b4e005fc03f0 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:56.543453 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-52fa86e7-ddfd-4fe1-9ed4-b4e005fc03f0 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:56.557018 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-52fa86e7-ddfd-4fe1-9ed4-b4e005fc03f0 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:56.563173 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-52fa86e7-ddfd-4fe1-9ed4-b4e005fc03f0 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:56.564271 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-52fa86e7-ddfd-4fe1-9ed4-b4e005fc03f0 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33" status: 200 len: 1731 microversion: 2.20 time: 0.244601 Apr 08 02:54:56.564794 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 453/904] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:54:56 2022] GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33 => generated 1731 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:54:57.032406 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [req-cf8bc72e-3816-46a0-85da-f40acec4b82e req-1469650b-9bd7-44db-9ec1-233dfa870064 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbeb7a47-a8ee-44b3-bc79-bd12670aaa33", "name": "network-vif-plugged", "status": "completed", "tag": "2bd62dce-ca58-4c9e-bb8a-99411d102c48"}]} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:54:57.038708 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:54:57.038708 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: warnings.warn(msg) Apr 08 02:54:57.059459 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-cf8bc72e-3816-46a0-85da-f40acec4b82e req-1469650b-9bd7-44db-9ec1-233dfa870064 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:57.060246 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-cf8bc72e-3816-46a0-85da-f40acec4b82e req-1469650b-9bd7-44db-9ec1-233dfa870064 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:57.082416 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.compute.server_external_events [req-cf8bc72e-3816-46a0-85da-f40acec4b82e req-1469650b-9bd7-44db-9ec1-233dfa870064 service nova] Creating event network-vif-plugged:2bd62dce-ca58-4c9e-bb8a-99411d102c48 for instance bbeb7a47-a8ee-44b3-bc79-bd12670aaa33 on hv-cinder-83705 Apr 08 02:54:57.091078 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [req-cf8bc72e-3816-46a0-85da-f40acec4b82e req-1469650b-9bd7-44db-9ec1-233dfa870064 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072757 Apr 08 02:54:57.092680 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 452/905] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:54:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:54:57.588661 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-20c370e9-0e50-4a6e-8776-ce151ebc2c01 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:57.589243 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-20c370e9-0e50-4a6e-8776-ce151ebc2c01 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: bbeb7a47-a8ee-44b3-bc79-bd12670aaa33] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:57.596526 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-20c370e9-0e50-4a6e-8776-ce151ebc2c01 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:57.596969 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-20c370e9-0e50-4a6e-8776-ce151ebc2c01 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:57.597739 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-20c370e9-0e50-4a6e-8776-ce151ebc2c01 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:57.598168 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-20c370e9-0e50-4a6e-8776-ce151ebc2c01 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:57.810609 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-20c370e9-0e50-4a6e-8776-ce151ebc2c01 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:57.826388 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-20c370e9-0e50-4a6e-8776-ce151ebc2c01 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:57.831861 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-20c370e9-0e50-4a6e-8776-ce151ebc2c01 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:57.833089 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-20c370e9-0e50-4a6e-8776-ce151ebc2c01 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33" status: 200 len: 1731 microversion: 2.20 time: 0.253892 Apr 08 02:54:57.834512 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 454/906] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:54:57 2022] GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33 => generated 1731 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:54:58.866515 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-5b78f8a0-0378-4be7-9621-14bb491e5886 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:54:58.867232 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-5b78f8a0-0378-4be7-9621-14bb491e5886 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: bbeb7a47-a8ee-44b3-bc79-bd12670aaa33] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:54:58.879727 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-5b78f8a0-0378-4be7-9621-14bb491e5886 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:58.880169 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-5b78f8a0-0378-4be7-9621-14bb491e5886 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:58.882162 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-5b78f8a0-0378-4be7-9621-14bb491e5886 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:54:58.882855 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-5b78f8a0-0378-4be7-9621-14bb491e5886 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:54:59.140640 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-5b78f8a0-0378-4be7-9621-14bb491e5886 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:59.155382 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-5b78f8a0-0378-4be7-9621-14bb491e5886 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:59.164880 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-5b78f8a0-0378-4be7-9621-14bb491e5886 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:54:59.167424 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-5b78f8a0-0378-4be7-9621-14bb491e5886 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33" status: 200 len: 1731 microversion: 2.20 time: 0.319097 Apr 08 02:54:59.168648 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 453/907] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:54:58 2022] GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33 => generated 1731 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:55:00.190231 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-78a73aee-86a9-4f18-8862-466d41fdb462 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:55:00.190802 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-78a73aee-86a9-4f18-8862-466d41fdb462 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: bbeb7a47-a8ee-44b3-bc79-bd12670aaa33] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:55:00.198625 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-78a73aee-86a9-4f18-8862-466d41fdb462 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:00.199089 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-78a73aee-86a9-4f18-8862-466d41fdb462 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:00.199909 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-78a73aee-86a9-4f18-8862-466d41fdb462 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:00.200335 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-78a73aee-86a9-4f18-8862-466d41fdb462 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:00.416597 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-78a73aee-86a9-4f18-8862-466d41fdb462 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:55:00.430059 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-78a73aee-86a9-4f18-8862-466d41fdb462 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:55:00.436120 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-78a73aee-86a9-4f18-8862-466d41fdb462 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:55:00.437221 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-78a73aee-86a9-4f18-8862-466d41fdb462 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33" status: 200 len: 1718 microversion: 2.20 time: 0.256202 Apr 08 02:55:00.437772 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 455/908] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:55:00 2022] GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33 => generated 1718 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:55:05.492563 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-81690948-78f0-4450-ab21-dffac8024731 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:55:05.493096 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-81690948-78f0-4450-ab21-dffac8024731 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 170aa648-5004-4e0d-9f78-aad5b2764ce1] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:55:05.500159 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-81690948-78f0-4450-ab21-dffac8024731 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:05.500595 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-81690948-78f0-4450-ab21-dffac8024731 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:05.501362 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-81690948-78f0-4450-ab21-dffac8024731 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:05.501793 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-81690948-78f0-4450-ab21-dffac8024731 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:05.575338 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-81690948-78f0-4450-ab21-dffac8024731 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/170aa648-5004-4e0d-9f78-aad5b2764ce1/ips" status: 200 len: 147 microversion: 2.1 time: 0.092665 Apr 08 02:55:05.575909 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 454/909] 10.222.0.48 () {58 vars in 1247 bytes} [Fri Apr 8 02:55:05 2022] GET /compute/v2.1/servers/170aa648-5004-4e0d-9f78-aad5b2764ce1/ips => generated 147 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:55:07.062951 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-c80f0c42-591e-4882-8643-ddcec72850fd tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0fc25a4e-eb31-44ef-9394-2b5724147935"}} {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:55:07.064130 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-c80f0c42-591e-4882-8643-ddcec72850fd tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 170aa648-5004-4e0d-9f78-aad5b2764ce1] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:55:07.072521 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c80f0c42-591e-4882-8643-ddcec72850fd tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:07.072964 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c80f0c42-591e-4882-8643-ddcec72850fd tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:07.073739 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c80f0c42-591e-4882-8643-ddcec72850fd tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:07.074173 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c80f0c42-591e-4882-8643-ddcec72850fd tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:07.426865 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-c80f0c42-591e-4882-8643-ddcec72850fd tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "POST /compute/v2.1/servers/170aa648-5004-4e0d-9f78-aad5b2764ce1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.373062 Apr 08 02:55:07.428262 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 456/910] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Apr 8 02:55:07 2022] POST /compute/v2.1/servers/170aa648-5004-4e0d-9f78-aad5b2764ce1/os-volume_attachments => generated 194 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:55:15.196818 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-a54b195f-1b9b-4a43-96d3-700491bee103 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:55:15.197731 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-a54b195f-1b9b-4a43-96d3-700491bee103 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 170aa648-5004-4e0d-9f78-aad5b2764ce1] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:55:15.204820 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-a54b195f-1b9b-4a43-96d3-700491bee103 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:15.205262 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-a54b195f-1b9b-4a43-96d3-700491bee103 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:15.206020 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-a54b195f-1b9b-4a43-96d3-700491bee103 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:15.206445 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-a54b195f-1b9b-4a43-96d3-700491bee103 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:15.275196 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-a54b195f-1b9b-4a43-96d3-700491bee103 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/170aa648-5004-4e0d-9f78-aad5b2764ce1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087229 Apr 08 02:55:15.275657 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 455/911] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Apr 8 02:55:15 2022] GET /compute/v2.1/servers/170aa648-5004-4e0d-9f78-aad5b2764ce1/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 02:55:15.292110 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-28e9d63b-3481-4da0-955d-8c16488b7f45 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:55:15.292677 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-28e9d63b-3481-4da0-955d-8c16488b7f45 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 170aa648-5004-4e0d-9f78-aad5b2764ce1] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:55:15.301036 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-28e9d63b-3481-4da0-955d-8c16488b7f45 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:15.301476 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-28e9d63b-3481-4da0-955d-8c16488b7f45 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:15.302472 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-28e9d63b-3481-4da0-955d-8c16488b7f45 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:15.302900 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-28e9d63b-3481-4da0-955d-8c16488b7f45 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:15.371553 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-28e9d63b-3481-4da0-955d-8c16488b7f45 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/170aa648-5004-4e0d-9f78-aad5b2764ce1/os-volume_attachments/0fc25a4e-eb31-44ef-9394-2b5724147935" status: 200 len: 194 microversion: 2.1 time: 0.089718 Apr 08 02:55:15.372112 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 457/912] 10.222.0.48 () {58 vars in 1412 bytes} [Fri Apr 8 02:55:15 2022] GET /compute/v2.1/servers/170aa648-5004-4e0d-9f78-aad5b2764ce1/os-volume_attachments/0fc25a4e-eb31-44ef-9394-2b5724147935 => generated 194 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:55:16.825735 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-4c9fb404-4add-404a-a8a7-d45a6bbee3b4 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "da5fe9e3-a0f1-4d38-8fb8-9169f96b6b0b"}} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:55:16.826826 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-4c9fb404-4add-404a-a8a7-d45a6bbee3b4 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 170aa648-5004-4e0d-9f78-aad5b2764ce1] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:55:16.834833 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-4c9fb404-4add-404a-a8a7-d45a6bbee3b4 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:16.835281 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-4c9fb404-4add-404a-a8a7-d45a6bbee3b4 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:16.836053 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-4c9fb404-4add-404a-a8a7-d45a6bbee3b4 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:16.836489 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-4c9fb404-4add-404a-a8a7-d45a6bbee3b4 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:17.180603 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-4c9fb404-4add-404a-a8a7-d45a6bbee3b4 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "POST /compute/v2.1/servers/170aa648-5004-4e0d-9f78-aad5b2764ce1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.364376 Apr 08 02:55:17.181190 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 456/913] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Apr 8 02:55:16 2022] POST /compute/v2.1/servers/170aa648-5004-4e0d-9f78-aad5b2764ce1/os-volume_attachments => generated 194 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:55:24.939625 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-03b0d6af-7cc8-4c27-b031-3ab5e4d87141 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:55:24.940533 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-03b0d6af-7cc8-4c27-b031-3ab5e4d87141 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 170aa648-5004-4e0d-9f78-aad5b2764ce1] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:55:24.948150 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-03b0d6af-7cc8-4c27-b031-3ab5e4d87141 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:24.948584 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-03b0d6af-7cc8-4c27-b031-3ab5e4d87141 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:24.949338 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-03b0d6af-7cc8-4c27-b031-3ab5e4d87141 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:24.949756 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-03b0d6af-7cc8-4c27-b031-3ab5e4d87141 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:25.018710 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-03b0d6af-7cc8-4c27-b031-3ab5e4d87141 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/170aa648-5004-4e0d-9f78-aad5b2764ce1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.088003 Apr 08 02:55:25.019258 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 458/914] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Apr 8 02:55:24 2022] GET /compute/v2.1/servers/170aa648-5004-4e0d-9f78-aad5b2764ce1/os-volume_attachments => generated 371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:55:25.175319 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-7c9fa4e3-4228-4151-b4df-01ef7514e54a tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:55:25.175873 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-7c9fa4e3-4228-4151-b4df-01ef7514e54a tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 170aa648-5004-4e0d-9f78-aad5b2764ce1] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:55:25.184513 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-7c9fa4e3-4228-4151-b4df-01ef7514e54a tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:25.184952 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-7c9fa4e3-4228-4151-b4df-01ef7514e54a tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:25.185710 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-7c9fa4e3-4228-4151-b4df-01ef7514e54a tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:25.186139 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-7c9fa4e3-4228-4151-b4df-01ef7514e54a tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:25.252863 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-7c9fa4e3-4228-4151-b4df-01ef7514e54a tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/170aa648-5004-4e0d-9f78-aad5b2764ce1/os-volume_attachments/0fc25a4e-eb31-44ef-9394-2b5724147935" status: 200 len: 194 microversion: 2.1 time: 0.089342 Apr 08 02:55:25.253434 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 457/915] 10.222.0.48 () {58 vars in 1412 bytes} [Fri Apr 8 02:55:25 2022] GET /compute/v2.1/servers/170aa648-5004-4e0d-9f78-aad5b2764ce1/os-volume_attachments/0fc25a4e-eb31-44ef-9394-2b5724147935 => generated 194 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:55:25.268977 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-fdf8c80f-4bcb-4a45-b840-b66c1077f3d0 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:55:25.269740 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-fdf8c80f-4bcb-4a45-b840-b66c1077f3d0 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 170aa648-5004-4e0d-9f78-aad5b2764ce1] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:55:25.277815 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-fdf8c80f-4bcb-4a45-b840-b66c1077f3d0 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:25.278250 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-fdf8c80f-4bcb-4a45-b840-b66c1077f3d0 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:25.279033 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-fdf8c80f-4bcb-4a45-b840-b66c1077f3d0 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:25.279459 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-fdf8c80f-4bcb-4a45-b840-b66c1077f3d0 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:25.517728 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-fdf8c80f-4bcb-4a45-b840-b66c1077f3d0 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "DELETE /compute/v2.1/servers/170aa648-5004-4e0d-9f78-aad5b2764ce1/os-volume_attachments/0fc25a4e-eb31-44ef-9394-2b5724147935" status: 202 len: 0 microversion: 2.1 time: 0.258013 Apr 08 02:55:25.518294 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 459/916] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Apr 8 02:55:25 2022] DELETE /compute/v2.1/servers/170aa648-5004-4e0d-9f78-aad5b2764ce1/os-volume_attachments/0fc25a4e-eb31-44ef-9394-2b5724147935 => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 02:55:27.781660 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-13e3e8ed-ffe7-4759-9dba-3ebf4ccddcd8 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:55:27.782157 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-13e3e8ed-ffe7-4759-9dba-3ebf4ccddcd8 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 170aa648-5004-4e0d-9f78-aad5b2764ce1] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:55:27.789599 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-13e3e8ed-ffe7-4759-9dba-3ebf4ccddcd8 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:27.790039 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-13e3e8ed-ffe7-4759-9dba-3ebf4ccddcd8 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:27.790825 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-13e3e8ed-ffe7-4759-9dba-3ebf4ccddcd8 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:27.791260 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-13e3e8ed-ffe7-4759-9dba-3ebf4ccddcd8 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:27.860741 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-13e3e8ed-ffe7-4759-9dba-3ebf4ccddcd8 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/170aa648-5004-4e0d-9f78-aad5b2764ce1/os-volume_attachments/da5fe9e3-a0f1-4d38-8fb8-9169f96b6b0b" status: 200 len: 194 microversion: 2.1 time: 0.088044 Apr 08 02:55:27.861355 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 458/917] 10.222.0.48 () {58 vars in 1412 bytes} [Fri Apr 8 02:55:27 2022] GET /compute/v2.1/servers/170aa648-5004-4e0d-9f78-aad5b2764ce1/os-volume_attachments/da5fe9e3-a0f1-4d38-8fb8-9169f96b6b0b => generated 194 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:55:27.877301 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-9a46c491-6ec7-4950-94c4-b3116908e80e tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:55:27.877868 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-9a46c491-6ec7-4950-94c4-b3116908e80e tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 170aa648-5004-4e0d-9f78-aad5b2764ce1] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:55:27.885783 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-9a46c491-6ec7-4950-94c4-b3116908e80e tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:27.886439 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-9a46c491-6ec7-4950-94c4-b3116908e80e tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:27.887228 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-9a46c491-6ec7-4950-94c4-b3116908e80e tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:27.887909 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-9a46c491-6ec7-4950-94c4-b3116908e80e tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:28.131239 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-9a46c491-6ec7-4950-94c4-b3116908e80e tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "DELETE /compute/v2.1/servers/170aa648-5004-4e0d-9f78-aad5b2764ce1/os-volume_attachments/da5fe9e3-a0f1-4d38-8fb8-9169f96b6b0b" status: 202 len: 0 microversion: 2.1 time: 0.262673 Apr 08 02:55:28.131816 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 460/918] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Apr 8 02:55:27 2022] DELETE /compute/v2.1/servers/170aa648-5004-4e0d-9f78-aad5b2764ce1/os-volume_attachments/da5fe9e3-a0f1-4d38-8fb8-9169f96b6b0b => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 02:55:29.388954 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-c1a6c73d-5fa2-4148-8fe3-4ba778ec4ae0 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:55:29.389927 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-c1a6c73d-5fa2-4148-8fe3-4ba778ec4ae0 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 170aa648-5004-4e0d-9f78-aad5b2764ce1] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:55:29.397007 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-c1a6c73d-5fa2-4148-8fe3-4ba778ec4ae0 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:29.397426 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-c1a6c73d-5fa2-4148-8fe3-4ba778ec4ae0 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:29.398184 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-c1a6c73d-5fa2-4148-8fe3-4ba778ec4ae0 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:29.398614 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-c1a6c73d-5fa2-4148-8fe3-4ba778ec4ae0 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:29.465604 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-c1a6c73d-5fa2-4148-8fe3-4ba778ec4ae0 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/170aa648-5004-4e0d-9f78-aad5b2764ce1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.086608 Apr 08 02:55:29.466144 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 459/919] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Apr 8 02:55:29 2022] GET /compute/v2.1/servers/170aa648-5004-4e0d-9f78-aad5b2764ce1/os-volume_attachments => generated 25 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 08 02:55:29.635923 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-79213f56-7213-4a5f-ad4c-6d0a87af330f tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:55:29.636906 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-79213f56-7213-4a5f-ad4c-6d0a87af330f tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 170aa648-5004-4e0d-9f78-aad5b2764ce1] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:55:29.644685 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-79213f56-7213-4a5f-ad4c-6d0a87af330f tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:29.645131 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-79213f56-7213-4a5f-ad4c-6d0a87af330f tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:29.645921 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-79213f56-7213-4a5f-ad4c-6d0a87af330f tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:29.646344 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-79213f56-7213-4a5f-ad4c-6d0a87af330f tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:29.713651 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-79213f56-7213-4a5f-ad4c-6d0a87af330f tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/170aa648-5004-4e0d-9f78-aad5b2764ce1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.088477 Apr 08 02:55:29.714199 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 461/920] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Apr 8 02:55:29 2022] GET /compute/v2.1/servers/170aa648-5004-4e0d-9f78-aad5b2764ce1/os-volume_attachments => generated 25 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 08 02:55:29.814118 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-229047fc-3aeb-4c77-a553-f6f6734865e6 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:55:29.814601 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-229047fc-3aeb-4c77-a553-f6f6734865e6 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 170aa648-5004-4e0d-9f78-aad5b2764ce1] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:55:29.821742 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-229047fc-3aeb-4c77-a553-f6f6734865e6 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:29.822180 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-229047fc-3aeb-4c77-a553-f6f6734865e6 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:29.822955 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-229047fc-3aeb-4c77-a553-f6f6734865e6 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:29.823384 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-229047fc-3aeb-4c77-a553-f6f6734865e6 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:29.886420 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-229047fc-3aeb-4c77-a553-f6f6734865e6 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 170aa648-5004-4e0d-9f78-aad5b2764ce1] Going to try to terminate instance {{(pid=96919) delete /opt/stack/nova/nova/compute/api.py:2559}} Apr 08 02:55:29.997559 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-229047fc-3aeb-4c77-a553-f6f6734865e6 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "DELETE /compute/v2.1/servers/170aa648-5004-4e0d-9f78-aad5b2764ce1" status: 204 len: 0 microversion: 2.1 time: 0.191853 Apr 08 02:55:30.001399 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 460/921] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Apr 8 02:55:29 2022] DELETE /compute/v2.1/servers/170aa648-5004-4e0d-9f78-aad5b2764ce1 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 08 02:55:30.013043 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-0a93d3eb-b8f7-4822-8f4c-c1b9d2b52c46 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:55:30.013652 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-0a93d3eb-b8f7-4822-8f4c-c1b9d2b52c46 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 170aa648-5004-4e0d-9f78-aad5b2764ce1] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:55:30.021692 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-0a93d3eb-b8f7-4822-8f4c-c1b9d2b52c46 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:30.022083 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-0a93d3eb-b8f7-4822-8f4c-c1b9d2b52c46 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:30.022892 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-0a93d3eb-b8f7-4822-8f4c-c1b9d2b52c46 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:30.023327 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-0a93d3eb-b8f7-4822-8f4c-c1b9d2b52c46 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:30.221760 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-0a93d3eb-b8f7-4822-8f4c-c1b9d2b52c46 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a88a8d7c9e4d0a88308c0e894570be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c31bb4f3ce486591bc142b1da7553e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:55:30.230609 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-0a93d3eb-b8f7-4822-8f4c-c1b9d2b52c46 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/170aa648-5004-4e0d-9f78-aad5b2764ce1" status: 200 len: 1674 microversion: 2.1 time: 0.227970 Apr 08 02:55:30.231177 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 462/922] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:55:30 2022] GET /compute/v2.1/servers/170aa648-5004-4e0d-9f78-aad5b2764ce1 => generated 1674 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:55:31.254122 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-2df51d31-57c4-4a79-a708-9b639ef22c62 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:55:31.254858 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-2df51d31-57c4-4a79-a708-9b639ef22c62 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 170aa648-5004-4e0d-9f78-aad5b2764ce1] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:55:31.262001 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-2df51d31-57c4-4a79-a708-9b639ef22c62 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:31.262440 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-2df51d31-57c4-4a79-a708-9b639ef22c62 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:31.263472 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-2df51d31-57c4-4a79-a708-9b639ef22c62 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:31.263897 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-2df51d31-57c4-4a79-a708-9b639ef22c62 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:31.466786 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-2df51d31-57c4-4a79-a708-9b639ef22c62 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a88a8d7c9e4d0a88308c0e894570be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c31bb4f3ce486591bc142b1da7553e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:55:31.475497 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-2df51d31-57c4-4a79-a708-9b639ef22c62 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/170aa648-5004-4e0d-9f78-aad5b2764ce1" status: 200 len: 1674 microversion: 2.1 time: 0.230873 Apr 08 02:55:31.476031 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 461/923] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:55:31 2022] GET /compute/v2.1/servers/170aa648-5004-4e0d-9f78-aad5b2764ce1 => generated 1674 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:55:32.497937 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-dce52867-f17f-4ff7-acbc-6e95dddb8e37 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:55:32.499334 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-dce52867-f17f-4ff7-acbc-6e95dddb8e37 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 170aa648-5004-4e0d-9f78-aad5b2764ce1] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:55:32.508854 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-dce52867-f17f-4ff7-acbc-6e95dddb8e37 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:32.509289 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-dce52867-f17f-4ff7-acbc-6e95dddb8e37 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:32.510061 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-dce52867-f17f-4ff7-acbc-6e95dddb8e37 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:32.510487 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-dce52867-f17f-4ff7-acbc-6e95dddb8e37 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:32.712601 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-dce52867-f17f-4ff7-acbc-6e95dddb8e37 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a88a8d7c9e4d0a88308c0e894570be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c31bb4f3ce486591bc142b1da7553e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:55:32.720595 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-dce52867-f17f-4ff7-acbc-6e95dddb8e37 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/170aa648-5004-4e0d-9f78-aad5b2764ce1" status: 200 len: 1674 microversion: 2.1 time: 0.232101 Apr 08 02:55:32.721124 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 463/924] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:55:32 2022] GET /compute/v2.1/servers/170aa648-5004-4e0d-9f78-aad5b2764ce1 => generated 1674 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:55:33.702908 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [req-ae411522-a369-4e42-9ccf-375d63f0d988 req-d4cd2ea4-3010-4470-88da-cd1b1e19f65c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "170aa648-5004-4e0d-9f78-aad5b2764ce1", "name": "network-vif-deleted", "tag": "c589e3c6-07ca-44fc-ae31-96e15494023f"}]} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:55:33.709868 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:55:33.709868 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: warnings.warn(msg) Apr 08 02:55:33.718755 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-ae411522-a369-4e42-9ccf-375d63f0d988 req-d4cd2ea4-3010-4470-88da-cd1b1e19f65c service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:33.719297 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-ae411522-a369-4e42-9ccf-375d63f0d988 req-d4cd2ea4-3010-4470-88da-cd1b1e19f65c service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:33.734354 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.compute.server_external_events [req-ae411522-a369-4e42-9ccf-375d63f0d988 req-d4cd2ea4-3010-4470-88da-cd1b1e19f65c service nova] Creating event network-vif-deleted:c589e3c6-07ca-44fc-ae31-96e15494023f for instance 170aa648-5004-4e0d-9f78-aad5b2764ce1 on hv-cinder-83705 Apr 08 02:55:33.739723 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [req-ae411522-a369-4e42-9ccf-375d63f0d988 req-d4cd2ea4-3010-4470-88da-cd1b1e19f65c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.266996 Apr 08 02:55:33.740444 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 462/925] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:55:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:55:33.744622 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-a5ad0466-5e5a-4c6a-a0da-e5a9646d2959 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:55:33.745764 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-a5ad0466-5e5a-4c6a-a0da-e5a9646d2959 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 170aa648-5004-4e0d-9f78-aad5b2764ce1] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:55:33.752946 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-a5ad0466-5e5a-4c6a-a0da-e5a9646d2959 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:33.753390 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-a5ad0466-5e5a-4c6a-a0da-e5a9646d2959 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:33.754166 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-a5ad0466-5e5a-4c6a-a0da-e5a9646d2959 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:33.754593 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-a5ad0466-5e5a-4c6a-a0da-e5a9646d2959 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:33.828153 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-a5ad0466-5e5a-4c6a-a0da-e5a9646d2959 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:33.828600 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-a5ad0466-5e5a-4c6a-a0da-e5a9646d2959 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:33.829041 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.objects.instance [None req-a5ad0466-5e5a-4c6a-a0da-e5a9646d2959 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lazy-loading 'fault' on Instance uuid 170aa648-5004-4e0d-9f78-aad5b2764ce1 {{(pid=96920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 08 02:55:33.887310 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-a5ad0466-5e5a-4c6a-a0da-e5a9646d2959 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a88a8d7c9e4d0a88308c0e894570be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c31bb4f3ce486591bc142b1da7553e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:55:33.896542 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-a5ad0466-5e5a-4c6a-a0da-e5a9646d2959 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/170aa648-5004-4e0d-9f78-aad5b2764ce1" status: 200 len: 1327 microversion: 2.1 time: 0.163059 Apr 08 02:55:33.906549 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 464/926] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:55:33 2022] GET /compute/v2.1/servers/170aa648-5004-4e0d-9f78-aad5b2764ce1 => generated 1327 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:55:34.919943 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-1a9db1c4-5ac9-4e2d-bc67-feea92fdf5b9 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:55:34.920621 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-1a9db1c4-5ac9-4e2d-bc67-feea92fdf5b9 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 170aa648-5004-4e0d-9f78-aad5b2764ce1] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:55:34.928627 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-1a9db1c4-5ac9-4e2d-bc67-feea92fdf5b9 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:34.929065 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-1a9db1c4-5ac9-4e2d-bc67-feea92fdf5b9 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:34.929829 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-1a9db1c4-5ac9-4e2d-bc67-feea92fdf5b9 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:34.930258 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-1a9db1c4-5ac9-4e2d-bc67-feea92fdf5b9 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:34.979252 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.wsgi [None req-1a9db1c4-5ac9-4e2d-bc67-feea92fdf5b9 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] HTTP exception thrown: Instance 170aa648-5004-4e0d-9f78-aad5b2764ce1 could not be found. Apr 08 02:55:34.979850 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-1a9db1c4-5ac9-4e2d-bc67-feea92fdf5b9 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Returning 404 to user: Instance 170aa648-5004-4e0d-9f78-aad5b2764ce1 could not be found. {{(pid=96919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Apr 08 02:55:34.980662 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-1a9db1c4-5ac9-4e2d-bc67-feea92fdf5b9 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/170aa648-5004-4e0d-9f78-aad5b2764ce1" status: 404 len: 111 microversion: 2.1 time: 0.071039 Apr 08 02:55:34.984561 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 463/927] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:55:34 2022] GET /compute/v2.1/servers/170aa648-5004-4e0d-9f78-aad5b2764ce1 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 02:55:34.995557 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-6691e409-9e65-4b89-a0b4-b80a93b1f8c9 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '.version_select at 0x7f7d4e2af8b0>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:55:35.018353 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-6691e409-9e65-4b89-a0b4-b80a93b1f8c9 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-738217636" status: 202 len: 0 microversion: 2.1 time: 0.032307 Apr 08 02:55:35.019745 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 465/928] 10.222.0.48 () {58 vars in 1217 bytes} [Fri Apr 8 02:55:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-738217636 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 02:55:36.087244 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-e43a45ec-d4c3-4600-9202-0e3cb8296f9f tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:55:36.088390 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-e43a45ec-d4c3-4600-9202-0e3cb8296f9f tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] [instance: 2fb4b617-e0c5-4496-858f-f139414f8fb5] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:55:36.090052 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [req-7cfa984b-33e5-4c97-8c77-2f82e6611a47 req-79445d70-1aff-4921-9ed5-bf910efd472f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fb4b617-e0c5-4496-858f-f139414f8fb5", "tag": "1be6ca01-4620-4592-8649-c93ad2064024"}]} {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:55:36.096732 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:55:36.096732 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: warnings.warn(msg) Apr 08 02:55:36.097426 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-e43a45ec-d4c3-4600-9202-0e3cb8296f9f tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:36.098073 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-e43a45ec-d4c3-4600-9202-0e3cb8296f9f tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:36.099637 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-e43a45ec-d4c3-4600-9202-0e3cb8296f9f tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:36.100249 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-e43a45ec-d4c3-4600-9202-0e3cb8296f9f tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:36.107417 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-7cfa984b-33e5-4c97-8c77-2f82e6611a47 req-79445d70-1aff-4921-9ed5-bf910efd472f service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:36.107863 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-7cfa984b-33e5-4c97-8c77-2f82e6611a47 req-79445d70-1aff-4921-9ed5-bf910efd472f service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:36.127088 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.compute.server_external_events [req-7cfa984b-33e5-4c97-8c77-2f82e6611a47 req-79445d70-1aff-4921-9ed5-bf910efd472f service nova] Creating event network-changed:1be6ca01-4620-4592-8649-c93ad2064024 for instance 2fb4b617-e0c5-4496-858f-f139414f8fb5 on hv-cinder-83705 Apr 08 02:55:36.132837 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [req-7cfa984b-33e5-4c97-8c77-2f82e6611a47 req-79445d70-1aff-4921-9ed5-bf910efd472f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052786 Apr 08 02:55:36.133886 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 466/929] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:55:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:55:36.190092 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-e43a45ec-d4c3-4600-9202-0e3cb8296f9f tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] [instance: 2fb4b617-e0c5-4496-858f-f139414f8fb5] Going to try to terminate instance {{(pid=96919) delete /opt/stack/nova/nova/compute/api.py:2559}} Apr 08 02:55:36.334984 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-e43a45ec-d4c3-4600-9202-0e3cb8296f9f tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] 10.222.0.48 "DELETE /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5" status: 204 len: 0 microversion: 2.1 time: 0.256661 Apr 08 02:55:36.336412 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 464/930] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Apr 8 02:55:36 2022] DELETE /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 08 02:55:36.350544 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-c1615f1f-4640-4fc9-aeb7-f7f2eb262e96 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:55:36.351434 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-c1615f1f-4640-4fc9-aeb7-f7f2eb262e96 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] [instance: 2fb4b617-e0c5-4496-858f-f139414f8fb5] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:55:36.359224 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c1615f1f-4640-4fc9-aeb7-f7f2eb262e96 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:36.359803 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c1615f1f-4640-4fc9-aeb7-f7f2eb262e96 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:36.360687 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c1615f1f-4640-4fc9-aeb7-f7f2eb262e96 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:36.362584 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c1615f1f-4640-4fc9-aeb7-f7f2eb262e96 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:36.607139 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-c1615f1f-4640-4fc9-aeb7-f7f2eb262e96 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86a950d41cc44fb9f10b600b20b0ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f311117084470f8e8d16c47ad1d2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:55:36.616885 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-c1615f1f-4640-4fc9-aeb7-f7f2eb262e96 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] 10.222.0.48 "GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5" status: 200 len: 1569 microversion: 2.1 time: 0.276148 Apr 08 02:55:36.617409 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 467/931] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:55:36 2022] GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5 => generated 1569 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:55:37.639279 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-1473d88e-32d9-4a38-82b4-40d7fbfbf76f tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:55:37.639957 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-1473d88e-32d9-4a38-82b4-40d7fbfbf76f tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] [instance: 2fb4b617-e0c5-4496-858f-f139414f8fb5] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:55:37.648597 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-1473d88e-32d9-4a38-82b4-40d7fbfbf76f tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:37.649037 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-1473d88e-32d9-4a38-82b4-40d7fbfbf76f tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:37.649874 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-1473d88e-32d9-4a38-82b4-40d7fbfbf76f tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:37.650312 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-1473d88e-32d9-4a38-82b4-40d7fbfbf76f tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:37.861869 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-1473d88e-32d9-4a38-82b4-40d7fbfbf76f tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86a950d41cc44fb9f10b600b20b0ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f311117084470f8e8d16c47ad1d2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:55:37.870497 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-1473d88e-32d9-4a38-82b4-40d7fbfbf76f tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] 10.222.0.48 "GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5" status: 200 len: 1450 microversion: 2.1 time: 0.240932 Apr 08 02:55:37.871146 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 465/932] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:55:37 2022] GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5 => generated 1450 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:55:38.564527 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-91857f0f-2a26-4530-a1f9-ba799924055e tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:55:38.565055 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-91857f0f-2a26-4530-a1f9-ba799924055e tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 170aa648-5004-4e0d-9f78-aad5b2764ce1] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:55:38.572931 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-91857f0f-2a26-4530-a1f9-ba799924055e tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:38.573378 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-91857f0f-2a26-4530-a1f9-ba799924055e tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:38.574151 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-91857f0f-2a26-4530-a1f9-ba799924055e tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:38.574577 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-91857f0f-2a26-4530-a1f9-ba799924055e tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:38.626989 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.wsgi [None req-91857f0f-2a26-4530-a1f9-ba799924055e tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] HTTP exception thrown: Instance 170aa648-5004-4e0d-9f78-aad5b2764ce1 could not be found. Apr 08 02:55:38.627588 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-91857f0f-2a26-4530-a1f9-ba799924055e tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Returning 404 to user: Instance 170aa648-5004-4e0d-9f78-aad5b2764ce1 could not be found. {{(pid=96920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Apr 08 02:55:38.628410 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-91857f0f-2a26-4530-a1f9-ba799924055e tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "DELETE /compute/v2.1/servers/170aa648-5004-4e0d-9f78-aad5b2764ce1" status: 404 len: 111 microversion: 2.1 time: 0.072959 Apr 08 02:55:38.628965 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 468/933] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Apr 8 02:55:38 2022] DELETE /compute/v2.1/servers/170aa648-5004-4e0d-9f78-aad5b2764ce1 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 02:55:38.642882 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-8eb3c95d-29f0-48e5-b3bb-424d9bc0d517 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:55:38.643485 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-8eb3c95d-29f0-48e5-b3bb-424d9bc0d517 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 170aa648-5004-4e0d-9f78-aad5b2764ce1] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:55:38.651208 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-8eb3c95d-29f0-48e5-b3bb-424d9bc0d517 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:38.651654 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-8eb3c95d-29f0-48e5-b3bb-424d9bc0d517 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:38.652424 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-8eb3c95d-29f0-48e5-b3bb-424d9bc0d517 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:38.652853 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-8eb3c95d-29f0-48e5-b3bb-424d9bc0d517 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:38.703135 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.wsgi [None req-8eb3c95d-29f0-48e5-b3bb-424d9bc0d517 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] HTTP exception thrown: Instance 170aa648-5004-4e0d-9f78-aad5b2764ce1 could not be found. Apr 08 02:55:38.703733 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-8eb3c95d-29f0-48e5-b3bb-424d9bc0d517 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Returning 404 to user: Instance 170aa648-5004-4e0d-9f78-aad5b2764ce1 could not be found. {{(pid=96919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Apr 08 02:55:38.704549 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-8eb3c95d-29f0-48e5-b3bb-424d9bc0d517 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/170aa648-5004-4e0d-9f78-aad5b2764ce1" status: 404 len: 111 microversion: 2.1 time: 0.070924 Apr 08 02:55:38.705100 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 466/934] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:55:38 2022] GET /compute/v2.1/servers/170aa648-5004-4e0d-9f78-aad5b2764ce1 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 02:55:38.893585 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-f7d01439-0e51-4e45-b70a-12fdb9d6818c tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:55:38.894416 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-f7d01439-0e51-4e45-b70a-12fdb9d6818c tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] [instance: 2fb4b617-e0c5-4496-858f-f139414f8fb5] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:55:38.897475 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [req-d0df34fb-8ec7-414e-88aa-3fb305c69a58 req-eb76ad4a-0a91-4569-92dd-fb9b0efdd07e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fb4b617-e0c5-4496-858f-f139414f8fb5", "name": "network-vif-deleted", "tag": "1be6ca01-4620-4592-8649-c93ad2064024"}]} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:55:38.903816 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-f7d01439-0e51-4e45-b70a-12fdb9d6818c tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:38.904258 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-f7d01439-0e51-4e45-b70a-12fdb9d6818c tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:38.904413 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:55:38.904413 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: warnings.warn(msg) Apr 08 02:55:38.905037 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-f7d01439-0e51-4e45-b70a-12fdb9d6818c tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:38.905469 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-f7d01439-0e51-4e45-b70a-12fdb9d6818c tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:38.913662 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-d0df34fb-8ec7-414e-88aa-3fb305c69a58 req-eb76ad4a-0a91-4569-92dd-fb9b0efdd07e service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:38.914110 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-d0df34fb-8ec7-414e-88aa-3fb305c69a58 req-eb76ad4a-0a91-4569-92dd-fb9b0efdd07e service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:38.931612 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.compute.server_external_events [req-d0df34fb-8ec7-414e-88aa-3fb305c69a58 req-eb76ad4a-0a91-4569-92dd-fb9b0efdd07e service nova] Creating event network-vif-deleted:1be6ca01-4620-4592-8649-c93ad2064024 for instance 2fb4b617-e0c5-4496-858f-f139414f8fb5 on hv-cinder-83705 Apr 08 02:55:38.936214 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [req-d0df34fb-8ec7-414e-88aa-3fb305c69a58 req-eb76ad4a-0a91-4569-92dd-fb9b0efdd07e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047874 Apr 08 02:55:38.936798 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 467/935] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:55:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:55:39.038944 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-f7d01439-0e51-4e45-b70a-12fdb9d6818c tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86a950d41cc44fb9f10b600b20b0ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f311117084470f8e8d16c47ad1d2ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:55:39.047128 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-f7d01439-0e51-4e45-b70a-12fdb9d6818c tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] 10.222.0.48 "GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5" status: 200 len: 1219 microversion: 2.1 time: 0.163256 Apr 08 02:55:39.047720 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 469/936] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:55:38 2022] GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5 => generated 1219 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:55:39.943575 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-577e8ae5-3155-4b17-9934-a9873d96fde6 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:55:39.944163 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-577e8ae5-3155-4b17-9934-a9873d96fde6 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 19ff8616-8e62-40fe-87e7-f976433b9288] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:55:39.951627 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-577e8ae5-3155-4b17-9934-a9873d96fde6 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:39.952076 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-577e8ae5-3155-4b17-9934-a9873d96fde6 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:39.952847 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-577e8ae5-3155-4b17-9934-a9873d96fde6 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:39.953290 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-577e8ae5-3155-4b17-9934-a9873d96fde6 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:40.004281 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.wsgi [None req-577e8ae5-3155-4b17-9934-a9873d96fde6 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] HTTP exception thrown: Instance 19ff8616-8e62-40fe-87e7-f976433b9288 could not be found. Apr 08 02:55:40.005442 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-577e8ae5-3155-4b17-9934-a9873d96fde6 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Returning 404 to user: Instance 19ff8616-8e62-40fe-87e7-f976433b9288 could not be found. {{(pid=96919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Apr 08 02:55:40.006401 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-577e8ae5-3155-4b17-9934-a9873d96fde6 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "DELETE /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288" status: 404 len: 111 microversion: 2.1 time: 0.077250 Apr 08 02:55:40.006978 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 468/937] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Apr 8 02:55:39 2022] DELETE /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 02:55:40.020091 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-5934e186-ceac-4b9b-9d84-a3bb40ce25a0 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:55:40.020772 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-5934e186-ceac-4b9b-9d84-a3bb40ce25a0 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] [instance: 19ff8616-8e62-40fe-87e7-f976433b9288] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:55:40.028035 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-5934e186-ceac-4b9b-9d84-a3bb40ce25a0 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:40.028474 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-5934e186-ceac-4b9b-9d84-a3bb40ce25a0 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:40.029234 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-5934e186-ceac-4b9b-9d84-a3bb40ce25a0 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:40.029663 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-5934e186-ceac-4b9b-9d84-a3bb40ce25a0 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:40.070004 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-fb6c1857-b614-4dd7-af81-bb0ae54614a6 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:55:40.070612 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-fb6c1857-b614-4dd7-af81-bb0ae54614a6 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] [instance: 2fb4b617-e0c5-4496-858f-f139414f8fb5] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:55:40.077773 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-fb6c1857-b614-4dd7-af81-bb0ae54614a6 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:40.078223 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-fb6c1857-b614-4dd7-af81-bb0ae54614a6 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:40.078928 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.wsgi [None req-5934e186-ceac-4b9b-9d84-a3bb40ce25a0 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] HTTP exception thrown: Instance 19ff8616-8e62-40fe-87e7-f976433b9288 could not be found. Apr 08 02:55:40.079051 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-fb6c1857-b614-4dd7-af81-bb0ae54614a6 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:40.079443 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-fb6c1857-b614-4dd7-af81-bb0ae54614a6 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:40.079539 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-5934e186-ceac-4b9b-9d84-a3bb40ce25a0 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] Returning 404 to user: Instance 19ff8616-8e62-40fe-87e7-f976433b9288 could not be found. {{(pid=96920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Apr 08 02:55:40.080325 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-5934e186-ceac-4b9b-9d84-a3bb40ce25a0 tempest-AttachVolumeTestJSON-696020671 tempest-AttachVolumeTestJSON-696020671-project] 10.222.0.48 "GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288" status: 404 len: 111 microversion: 2.1 time: 0.069408 Apr 08 02:55:40.080869 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 470/938] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:55:40 2022] GET /compute/v2.1/servers/19ff8616-8e62-40fe-87e7-f976433b9288 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 02:55:40.128336 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.wsgi [None req-fb6c1857-b614-4dd7-af81-bb0ae54614a6 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] HTTP exception thrown: Instance 2fb4b617-e0c5-4496-858f-f139414f8fb5 could not be found. Apr 08 02:55:40.128989 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-fb6c1857-b614-4dd7-af81-bb0ae54614a6 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Returning 404 to user: Instance 2fb4b617-e0c5-4496-858f-f139414f8fb5 could not be found. {{(pid=96919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Apr 08 02:55:40.130345 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-fb6c1857-b614-4dd7-af81-bb0ae54614a6 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] 10.222.0.48 "GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5" status: 404 len: 111 microversion: 2.1 time: 0.069646 Apr 08 02:55:40.130917 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 469/939] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:55:40 2022] GET /compute/v2.1/servers/2fb4b617-e0c5-4496-858f-f139414f8fb5 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 08 02:55:40.492314 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-a97caf73-0064-42e5-b44e-87174cefec00 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] Calling method '.version_select at 0x7f7d4e46d280>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:55:40.514293 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-a97caf73-0064-42e5-b44e-87174cefec00 tempest-TestShelveInstance-808265055 tempest-TestShelveInstance-808265055-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-386305352" status: 202 len: 0 microversion: 2.1 time: 0.031442 Apr 08 02:55:40.514884 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 471/940] 10.222.0.48 () {58 vars in 1250 bytes} [Fri Apr 8 02:55:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-386305352 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 02:55:42.138616 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-e2109903-bb90-458e-b6d9-c6a2b3873980 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:55:42.139689 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-e2109903-bb90-458e-b6d9-c6a2b3873980 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 0e706772-9e50-42af-9390-833fc586edb5] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:55:42.148587 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-e2109903-bb90-458e-b6d9-c6a2b3873980 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:42.149439 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-e2109903-bb90-458e-b6d9-c6a2b3873980 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:42.150213 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-e2109903-bb90-458e-b6d9-c6a2b3873980 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:42.150877 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-e2109903-bb90-458e-b6d9-c6a2b3873980 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:42.222356 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-e2109903-bb90-458e-b6d9-c6a2b3873980 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/0e706772-9e50-42af-9390-833fc586edb5/ips" status: 200 len: 149 microversion: 2.1 time: 0.094310 Apr 08 02:55:42.223750 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 470/941] 10.222.0.48 () {58 vars in 1247 bytes} [Fri Apr 8 02:55:42 2022] GET /compute/v2.1/servers/0e706772-9e50-42af-9390-833fc586edb5/ips => generated 149 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:55:43.874352 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-18f75de1-a71d-4c59-8823-c12c7353d622 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4ab0487c-b5de-433f-880b-7521c349c501"}} {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:55:43.882645 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-18f75de1-a71d-4c59-8823-c12c7353d622 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 0e706772-9e50-42af-9390-833fc586edb5] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:55:43.892561 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-18f75de1-a71d-4c59-8823-c12c7353d622 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:43.893274 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-18f75de1-a71d-4c59-8823-c12c7353d622 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:43.894204 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-18f75de1-a71d-4c59-8823-c12c7353d622 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:43.895285 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-18f75de1-a71d-4c59-8823-c12c7353d622 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:44.462388 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-18f75de1-a71d-4c59-8823-c12c7353d622 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "POST /compute/v2.1/servers/0e706772-9e50-42af-9390-833fc586edb5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.601809 Apr 08 02:55:44.463804 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 472/942] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Apr 8 02:55:43 2022] POST /compute/v2.1/servers/0e706772-9e50-42af-9390-833fc586edb5/os-volume_attachments => generated 194 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:55:52.533066 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-b6e07005-3d67-40a7-8714-c406d860aaa6 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:55:52.533830 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-b6e07005-3d67-40a7-8714-c406d860aaa6 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 0e706772-9e50-42af-9390-833fc586edb5] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:55:52.542045 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b6e07005-3d67-40a7-8714-c406d860aaa6 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:52.542344 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b6e07005-3d67-40a7-8714-c406d860aaa6 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:52.543373 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b6e07005-3d67-40a7-8714-c406d860aaa6 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:52.543811 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b6e07005-3d67-40a7-8714-c406d860aaa6 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:52.793959 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-b6e07005-3d67-40a7-8714-c406d860aaa6 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0e706772-9e50-42af-9390-833fc586edb5/os-volume_attachments/4ab0487c-b5de-433f-880b-7521c349c501" status: 202 len: 0 microversion: 2.1 time: 0.270668 Apr 08 02:55:52.795464 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 471/943] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Apr 8 02:55:52 2022] DELETE /compute/v2.1/servers/0e706772-9e50-42af-9390-833fc586edb5/os-volume_attachments/4ab0487c-b5de-433f-880b-7521c349c501 => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 02:55:52.812454 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-6f1e4ae5-77c0-4c0a-b204-5a3be7ea24d4 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:55:52.813555 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-6f1e4ae5-77c0-4c0a-b204-5a3be7ea24d4 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 0e706772-9e50-42af-9390-833fc586edb5] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:55:52.824806 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-6f1e4ae5-77c0-4c0a-b204-5a3be7ea24d4 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:52.825250 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-6f1e4ae5-77c0-4c0a-b204-5a3be7ea24d4 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:52.826018 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-6f1e4ae5-77c0-4c0a-b204-5a3be7ea24d4 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:52.826440 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-6f1e4ae5-77c0-4c0a-b204-5a3be7ea24d4 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:52.899014 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-6f1e4ae5-77c0-4c0a-b204-5a3be7ea24d4 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/0e706772-9e50-42af-9390-833fc586edb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097617 Apr 08 02:55:52.902798 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 473/944] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Apr 8 02:55:52 2022] GET /compute/v2.1/servers/0e706772-9e50-42af-9390-833fc586edb5/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:55:53.920905 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-71157db7-4c12-43db-b7ca-70eb568fd64a tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:55:53.922173 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-71157db7-4c12-43db-b7ca-70eb568fd64a tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 0e706772-9e50-42af-9390-833fc586edb5] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:55:53.932054 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-71157db7-4c12-43db-b7ca-70eb568fd64a tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:53.932710 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-71157db7-4c12-43db-b7ca-70eb568fd64a tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:53.933652 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-71157db7-4c12-43db-b7ca-70eb568fd64a tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:53.934229 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-71157db7-4c12-43db-b7ca-70eb568fd64a tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:54.013741 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-71157db7-4c12-43db-b7ca-70eb568fd64a tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/0e706772-9e50-42af-9390-833fc586edb5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.102887 Apr 08 02:55:54.014286 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 472/945] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Apr 8 02:55:53 2022] GET /compute/v2.1/servers/0e706772-9e50-42af-9390-833fc586edb5/os-volume_attachments => generated 25 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 08 02:55:54.126256 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-baf2243a-a9ec-47e6-bce6-5d813b138f34 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:55:54.126857 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-baf2243a-a9ec-47e6-bce6-5d813b138f34 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 0e706772-9e50-42af-9390-833fc586edb5] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:55:54.135481 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-baf2243a-a9ec-47e6-bce6-5d813b138f34 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:54.136171 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-baf2243a-a9ec-47e6-bce6-5d813b138f34 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:54.137139 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-baf2243a-a9ec-47e6-bce6-5d813b138f34 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:54.137992 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-baf2243a-a9ec-47e6-bce6-5d813b138f34 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:54.212075 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-baf2243a-a9ec-47e6-bce6-5d813b138f34 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 0e706772-9e50-42af-9390-833fc586edb5] Going to try to terminate instance {{(pid=96920) delete /opt/stack/nova/nova/compute/api.py:2559}} Apr 08 02:55:54.329711 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-baf2243a-a9ec-47e6-bce6-5d813b138f34 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0e706772-9e50-42af-9390-833fc586edb5" status: 204 len: 0 microversion: 2.1 time: 0.212226 Apr 08 02:55:54.330270 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 474/946] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Apr 8 02:55:54 2022] DELETE /compute/v2.1/servers/0e706772-9e50-42af-9390-833fc586edb5 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 08 02:55:54.343441 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-a3c57a24-daa4-4eb1-bc05-24fa5ee4b158 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:55:54.344037 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-a3c57a24-daa4-4eb1-bc05-24fa5ee4b158 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 0e706772-9e50-42af-9390-833fc586edb5] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:55:54.351391 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-a3c57a24-daa4-4eb1-bc05-24fa5ee4b158 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:54.351835 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-a3c57a24-daa4-4eb1-bc05-24fa5ee4b158 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:54.352598 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-a3c57a24-daa4-4eb1-bc05-24fa5ee4b158 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:54.353021 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-a3c57a24-daa4-4eb1-bc05-24fa5ee4b158 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:54.559088 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-a3c57a24-daa4-4eb1-bc05-24fa5ee4b158 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68bc45984974d6da1c9151c21dae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbf5bb7e51d4d2d8594d6d1d3a797a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:55:54.567937 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-a3c57a24-daa4-4eb1-bc05-24fa5ee4b158 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/0e706772-9e50-42af-9390-833fc586edb5" status: 200 len: 1679 microversion: 2.1 time: 0.233083 Apr 08 02:55:54.570700 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 473/947] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:55:54 2022] GET /compute/v2.1/servers/0e706772-9e50-42af-9390-833fc586edb5 => generated 1679 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:55:55.590546 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-fa0a2287-e8e0-4ac7-9feb-0e588a2f6499 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:55:55.591259 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-fa0a2287-e8e0-4ac7-9feb-0e588a2f6499 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 0e706772-9e50-42af-9390-833fc586edb5] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:55:55.598810 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-fa0a2287-e8e0-4ac7-9feb-0e588a2f6499 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:55.599250 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-fa0a2287-e8e0-4ac7-9feb-0e588a2f6499 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:55.600009 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-fa0a2287-e8e0-4ac7-9feb-0e588a2f6499 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:55.600436 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-fa0a2287-e8e0-4ac7-9feb-0e588a2f6499 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:55.817082 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-fa0a2287-e8e0-4ac7-9feb-0e588a2f6499 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68bc45984974d6da1c9151c21dae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbf5bb7e51d4d2d8594d6d1d3a797a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:55:55.826000 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-fa0a2287-e8e0-4ac7-9feb-0e588a2f6499 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/0e706772-9e50-42af-9390-833fc586edb5" status: 200 len: 1679 microversion: 2.1 time: 0.244762 Apr 08 02:55:55.826545 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 475/948] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:55:55 2022] GET /compute/v2.1/servers/0e706772-9e50-42af-9390-833fc586edb5 => generated 1679 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:55:56.849522 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-fcf61c08-8c69-497c-bb49-5e230896a11c tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:55:56.850135 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-fcf61c08-8c69-497c-bb49-5e230896a11c tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 0e706772-9e50-42af-9390-833fc586edb5] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:55:56.857516 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-fcf61c08-8c69-497c-bb49-5e230896a11c tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:56.857958 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-fcf61c08-8c69-497c-bb49-5e230896a11c tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:56.858803 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-fcf61c08-8c69-497c-bb49-5e230896a11c tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:56.859233 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-fcf61c08-8c69-497c-bb49-5e230896a11c tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:56.985482 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-fcf61c08-8c69-497c-bb49-5e230896a11c tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68bc45984974d6da1c9151c21dae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbf5bb7e51d4d2d8594d6d1d3a797a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:55:56.996791 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-fcf61c08-8c69-497c-bb49-5e230896a11c tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/0e706772-9e50-42af-9390-833fc586edb5" status: 200 len: 1612 microversion: 2.1 time: 0.156968 Apr 08 02:55:56.997940 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 474/949] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:55:56 2022] GET /compute/v2.1/servers/0e706772-9e50-42af-9390-833fc586edb5 => generated 1612 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:55:57.538857 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [req-c42d276f-6aac-43a0-b8dc-86a0297da3eb req-d7ad9c49-8ee0-473c-97b0-923c3105b7f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e706772-9e50-42af-9390-833fc586edb5", "name": "network-vif-deleted", "tag": "eb3af547-8a95-465b-b99d-7ab718c88e31"}]} {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:55:57.545575 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:55:57.545575 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: warnings.warn(msg) Apr 08 02:55:57.557967 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-c42d276f-6aac-43a0-b8dc-86a0297da3eb req-d7ad9c49-8ee0-473c-97b0-923c3105b7f0 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:57.558407 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-c42d276f-6aac-43a0-b8dc-86a0297da3eb req-d7ad9c49-8ee0-473c-97b0-923c3105b7f0 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:57.575982 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.compute.server_external_events [req-c42d276f-6aac-43a0-b8dc-86a0297da3eb req-d7ad9c49-8ee0-473c-97b0-923c3105b7f0 service nova] Creating event network-vif-deleted:eb3af547-8a95-465b-b99d-7ab718c88e31 for instance 0e706772-9e50-42af-9390-833fc586edb5 on hv-cinder-83705 Apr 08 02:55:57.580713 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [req-c42d276f-6aac-43a0-b8dc-86a0297da3eb req-d7ad9c49-8ee0-473c-97b0-923c3105b7f0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053307 Apr 08 02:55:57.581743 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 476/950] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:55:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:55:58.019148 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-108b8d1f-b853-47d7-aa2d-38f3f6dd093b tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:55:58.022960 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-108b8d1f-b853-47d7-aa2d-38f3f6dd093b tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 0e706772-9e50-42af-9390-833fc586edb5] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:55:58.038517 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-108b8d1f-b853-47d7-aa2d-38f3f6dd093b tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:58.039151 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-108b8d1f-b853-47d7-aa2d-38f3f6dd093b tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:58.041018 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-108b8d1f-b853-47d7-aa2d-38f3f6dd093b tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:58.041656 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-108b8d1f-b853-47d7-aa2d-38f3f6dd093b tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:58.125741 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-108b8d1f-b853-47d7-aa2d-38f3f6dd093b tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:58.126186 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-108b8d1f-b853-47d7-aa2d-38f3f6dd093b tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:58.126636 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.objects.instance [None req-108b8d1f-b853-47d7-aa2d-38f3f6dd093b tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lazy-loading 'fault' on Instance uuid 0e706772-9e50-42af-9390-833fc586edb5 {{(pid=96919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 08 02:55:58.194520 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-108b8d1f-b853-47d7-aa2d-38f3f6dd093b tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68bc45984974d6da1c9151c21dae14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbf5bb7e51d4d2d8594d6d1d3a797a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:55:58.202498 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-108b8d1f-b853-47d7-aa2d-38f3f6dd093b tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/0e706772-9e50-42af-9390-833fc586edb5" status: 200 len: 1330 microversion: 2.1 time: 0.192702 Apr 08 02:55:58.212112 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 475/951] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:55:58 2022] GET /compute/v2.1/servers/0e706772-9e50-42af-9390-833fc586edb5 => generated 1330 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:55:59.225544 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-d7f659e4-26b6-4371-8e0b-ce16b86d7f68 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:55:59.226226 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-d7f659e4-26b6-4371-8e0b-ce16b86d7f68 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 0e706772-9e50-42af-9390-833fc586edb5] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:55:59.233460 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-d7f659e4-26b6-4371-8e0b-ce16b86d7f68 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:59.233894 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-d7f659e4-26b6-4371-8e0b-ce16b86d7f68 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:59.234646 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-d7f659e4-26b6-4371-8e0b-ce16b86d7f68 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:55:59.235100 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-d7f659e4-26b6-4371-8e0b-ce16b86d7f68 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:55:59.285877 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.wsgi [None req-d7f659e4-26b6-4371-8e0b-ce16b86d7f68 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] HTTP exception thrown: Instance 0e706772-9e50-42af-9390-833fc586edb5 could not be found. Apr 08 02:55:59.286590 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-d7f659e4-26b6-4371-8e0b-ce16b86d7f68 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Returning 404 to user: Instance 0e706772-9e50-42af-9390-833fc586edb5 could not be found. {{(pid=96920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Apr 08 02:55:59.287433 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-d7f659e4-26b6-4371-8e0b-ce16b86d7f68 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/0e706772-9e50-42af-9390-833fc586edb5" status: 404 len: 111 microversion: 2.1 time: 0.071887 Apr 08 02:55:59.287982 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 477/952] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:55:59 2022] GET /compute/v2.1/servers/0e706772-9e50-42af-9390-833fc586edb5 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 02:55:59.301512 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-84e3d394-f14a-47be-afcb-96bf6e60a41b tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '.version_select at 0x7f7d4e5a9820>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:55:59.324105 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-84e3d394-f14a-47be-afcb-96bf6e60a41b tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-123723757" status: 202 len: 0 microversion: 2.1 time: 0.031570 Apr 08 02:55:59.324779 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 476/953] 10.222.0.48 () {58 vars in 1217 bytes} [Fri Apr 8 02:55:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-123723757 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 08 02:56:01.487480 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-a74e060e-7677-4377-bee0-856f3f9499d7 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:01.488065 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-a74e060e-7677-4377-bee0-856f3f9499d7 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 0e706772-9e50-42af-9390-833fc586edb5] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:56:01.496325 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-a74e060e-7677-4377-bee0-856f3f9499d7 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:01.496762 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-a74e060e-7677-4377-bee0-856f3f9499d7 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:01.497533 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-a74e060e-7677-4377-bee0-856f3f9499d7 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:01.497957 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-a74e060e-7677-4377-bee0-856f3f9499d7 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:01.548805 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.wsgi [None req-a74e060e-7677-4377-bee0-856f3f9499d7 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] HTTP exception thrown: Instance 0e706772-9e50-42af-9390-833fc586edb5 could not be found. Apr 08 02:56:01.549401 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-a74e060e-7677-4377-bee0-856f3f9499d7 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Returning 404 to user: Instance 0e706772-9e50-42af-9390-833fc586edb5 could not be found. {{(pid=96920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Apr 08 02:56:01.550213 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-a74e060e-7677-4377-bee0-856f3f9499d7 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0e706772-9e50-42af-9390-833fc586edb5" status: 404 len: 111 microversion: 2.1 time: 0.071773 Apr 08 02:56:01.555061 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 478/954] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Apr 8 02:56:01 2022] DELETE /compute/v2.1/servers/0e706772-9e50-42af-9390-833fc586edb5 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 02:56:01.565728 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-be1c217a-cb55-4ba2-9ab1-e0ae6fc6c2a3 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:01.566372 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-be1c217a-cb55-4ba2-9ab1-e0ae6fc6c2a3 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 0e706772-9e50-42af-9390-833fc586edb5] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:56:01.575334 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-be1c217a-cb55-4ba2-9ab1-e0ae6fc6c2a3 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:01.575774 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-be1c217a-cb55-4ba2-9ab1-e0ae6fc6c2a3 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:01.576583 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-be1c217a-cb55-4ba2-9ab1-e0ae6fc6c2a3 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:01.576988 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-be1c217a-cb55-4ba2-9ab1-e0ae6fc6c2a3 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:01.625754 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.wsgi [None req-be1c217a-cb55-4ba2-9ab1-e0ae6fc6c2a3 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] HTTP exception thrown: Instance 0e706772-9e50-42af-9390-833fc586edb5 could not be found. Apr 08 02:56:01.626362 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-be1c217a-cb55-4ba2-9ab1-e0ae6fc6c2a3 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Returning 404 to user: Instance 0e706772-9e50-42af-9390-833fc586edb5 could not be found. {{(pid=96919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Apr 08 02:56:01.627183 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-be1c217a-cb55-4ba2-9ab1-e0ae6fc6c2a3 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/0e706772-9e50-42af-9390-833fc586edb5" status: 404 len: 111 microversion: 2.1 time: 0.070564 Apr 08 02:56:01.627732 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 477/955] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:56:01 2022] GET /compute/v2.1/servers/0e706772-9e50-42af-9390-833fc586edb5 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 02:56:02.863806 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-42bfa016-bf95-4bff-8567-346aa192166f tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:02.864364 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-42bfa016-bf95-4bff-8567-346aa192166f tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 991d0926-dfa5-43b7-a6d4-b745f1bb8e59] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:56:02.871360 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-42bfa016-bf95-4bff-8567-346aa192166f tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:02.871802 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-42bfa016-bf95-4bff-8567-346aa192166f tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:02.872563 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-42bfa016-bf95-4bff-8567-346aa192166f tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:02.872989 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-42bfa016-bf95-4bff-8567-346aa192166f tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:02.925993 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.wsgi [None req-42bfa016-bf95-4bff-8567-346aa192166f tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] HTTP exception thrown: Instance 991d0926-dfa5-43b7-a6d4-b745f1bb8e59 could not be found. Apr 08 02:56:02.926615 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-42bfa016-bf95-4bff-8567-346aa192166f tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Returning 404 to user: Instance 991d0926-dfa5-43b7-a6d4-b745f1bb8e59 could not be found. {{(pid=96920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Apr 08 02:56:02.927462 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-42bfa016-bf95-4bff-8567-346aa192166f tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "DELETE /compute/v2.1/servers/991d0926-dfa5-43b7-a6d4-b745f1bb8e59" status: 404 len: 111 microversion: 2.1 time: 0.072642 Apr 08 02:56:02.928013 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 479/956] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Apr 8 02:56:02 2022] DELETE /compute/v2.1/servers/991d0926-dfa5-43b7-a6d4-b745f1bb8e59 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 02:56:02.943923 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-398a10c3-ed3c-41bd-a3d0-783f022bde9a tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:02.945152 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-398a10c3-ed3c-41bd-a3d0-783f022bde9a tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 991d0926-dfa5-43b7-a6d4-b745f1bb8e59] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:56:02.964272 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-398a10c3-ed3c-41bd-a3d0-783f022bde9a tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:02.964956 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-398a10c3-ed3c-41bd-a3d0-783f022bde9a tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:02.965960 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-398a10c3-ed3c-41bd-a3d0-783f022bde9a tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:02.966609 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-398a10c3-ed3c-41bd-a3d0-783f022bde9a tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:03.017318 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.wsgi [None req-398a10c3-ed3c-41bd-a3d0-783f022bde9a tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] HTTP exception thrown: Instance 991d0926-dfa5-43b7-a6d4-b745f1bb8e59 could not be found. Apr 08 02:56:03.017915 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-398a10c3-ed3c-41bd-a3d0-783f022bde9a tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Returning 404 to user: Instance 991d0926-dfa5-43b7-a6d4-b745f1bb8e59 could not be found. {{(pid=96919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Apr 08 02:56:03.018749 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-398a10c3-ed3c-41bd-a3d0-783f022bde9a tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/991d0926-dfa5-43b7-a6d4-b745f1bb8e59" status: 404 len: 111 microversion: 2.1 time: 0.086448 Apr 08 02:56:03.019704 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 478/957] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:56:02 2022] GET /compute/v2.1/servers/991d0926-dfa5-43b7-a6d4-b745f1bb8e59 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 02:56:03.033071 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-72ae7242-bec8-429b-bc03-472eb607bc38 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:03.033556 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-72ae7242-bec8-429b-bc03-472eb607bc38 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: de7be542-3f1f-4b34-a68c-4500efe9f8d9] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:56:03.040814 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-72ae7242-bec8-429b-bc03-472eb607bc38 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:03.041257 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-72ae7242-bec8-429b-bc03-472eb607bc38 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:03.042010 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-72ae7242-bec8-429b-bc03-472eb607bc38 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:03.042437 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-72ae7242-bec8-429b-bc03-472eb607bc38 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:03.093350 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.wsgi [None req-72ae7242-bec8-429b-bc03-472eb607bc38 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] HTTP exception thrown: Instance de7be542-3f1f-4b34-a68c-4500efe9f8d9 could not be found. Apr 08 02:56:03.093942 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-72ae7242-bec8-429b-bc03-472eb607bc38 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Returning 404 to user: Instance de7be542-3f1f-4b34-a68c-4500efe9f8d9 could not be found. {{(pid=96920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Apr 08 02:56:03.094784 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-72ae7242-bec8-429b-bc03-472eb607bc38 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "DELETE /compute/v2.1/servers/de7be542-3f1f-4b34-a68c-4500efe9f8d9" status: 404 len: 111 microversion: 2.1 time: 0.070663 Apr 08 02:56:03.095337 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 480/958] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Apr 8 02:56:03 2022] DELETE /compute/v2.1/servers/de7be542-3f1f-4b34-a68c-4500efe9f8d9 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 02:56:03.108597 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-53edea54-1025-4962-87a8-493491d0aab7 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:03.109196 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-53edea54-1025-4962-87a8-493491d0aab7 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: de7be542-3f1f-4b34-a68c-4500efe9f8d9] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:56:03.117366 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-53edea54-1025-4962-87a8-493491d0aab7 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:03.117810 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-53edea54-1025-4962-87a8-493491d0aab7 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:03.118873 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-53edea54-1025-4962-87a8-493491d0aab7 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:03.119297 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-53edea54-1025-4962-87a8-493491d0aab7 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:03.171695 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.wsgi [None req-53edea54-1025-4962-87a8-493491d0aab7 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] HTTP exception thrown: Instance de7be542-3f1f-4b34-a68c-4500efe9f8d9 could not be found. Apr 08 02:56:03.172288 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-53edea54-1025-4962-87a8-493491d0aab7 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Returning 404 to user: Instance de7be542-3f1f-4b34-a68c-4500efe9f8d9 could not be found. {{(pid=96919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Apr 08 02:56:03.173099 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-53edea54-1025-4962-87a8-493491d0aab7 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/de7be542-3f1f-4b34-a68c-4500efe9f8d9" status: 404 len: 111 microversion: 2.1 time: 0.073551 Apr 08 02:56:03.173645 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 479/959] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:56:03 2022] GET /compute/v2.1/servers/de7be542-3f1f-4b34-a68c-4500efe9f8d9 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 02:56:04.404477 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-e0e9c777-61e6-4750-874d-2f6665c8bafd tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:04.405011 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-e0e9c777-61e6-4750-874d-2f6665c8bafd tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 09e6abc6-19f4-4355-8309-fb3279d9b5e3] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:56:04.412568 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-e0e9c777-61e6-4750-874d-2f6665c8bafd tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:04.413010 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-e0e9c777-61e6-4750-874d-2f6665c8bafd tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:04.413773 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-e0e9c777-61e6-4750-874d-2f6665c8bafd tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:04.414199 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-e0e9c777-61e6-4750-874d-2f6665c8bafd tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:04.464130 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.wsgi [None req-e0e9c777-61e6-4750-874d-2f6665c8bafd tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] HTTP exception thrown: Instance 09e6abc6-19f4-4355-8309-fb3279d9b5e3 could not be found. Apr 08 02:56:04.464626 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-e0e9c777-61e6-4750-874d-2f6665c8bafd tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Returning 404 to user: Instance 09e6abc6-19f4-4355-8309-fb3279d9b5e3 could not be found. {{(pid=96920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Apr 08 02:56:04.465440 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-e0e9c777-61e6-4750-874d-2f6665c8bafd tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "DELETE /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3" status: 404 len: 111 microversion: 2.1 time: 0.070945 Apr 08 02:56:04.465988 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 481/960] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Apr 8 02:56:04 2022] DELETE /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 02:56:04.479260 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-ad28e862-d897-49ef-a63e-52ddbb2c2257 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:04.479859 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-ad28e862-d897-49ef-a63e-52ddbb2c2257 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] [instance: 09e6abc6-19f4-4355-8309-fb3279d9b5e3] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:56:04.487011 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ad28e862-d897-49ef-a63e-52ddbb2c2257 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:04.487448 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ad28e862-d897-49ef-a63e-52ddbb2c2257 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:04.488213 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ad28e862-d897-49ef-a63e-52ddbb2c2257 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:04.488639 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ad28e862-d897-49ef-a63e-52ddbb2c2257 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:04.537170 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.wsgi [None req-ad28e862-d897-49ef-a63e-52ddbb2c2257 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] HTTP exception thrown: Instance 09e6abc6-19f4-4355-8309-fb3279d9b5e3 could not be found. Apr 08 02:56:04.537747 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-ad28e862-d897-49ef-a63e-52ddbb2c2257 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] Returning 404 to user: Instance 09e6abc6-19f4-4355-8309-fb3279d9b5e3 could not be found. {{(pid=96919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Apr 08 02:56:04.538540 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-ad28e862-d897-49ef-a63e-52ddbb2c2257 tempest-AttachVolumeNegativeTest-1285313694 tempest-AttachVolumeNegativeTest-1285313694-project] 10.222.0.48 "GET /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3" status: 404 len: 111 microversion: 2.1 time: 0.068518 Apr 08 02:56:04.539100 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 480/961] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:56:04 2022] GET /compute/v2.1/servers/09e6abc6-19f4-4355-8309-fb3279d9b5e3 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 02:56:07.229105 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-4a8c1fc0-0db6-4def-8665-fe95ac97f338 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:07.230498 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-4a8c1fc0-0db6-4def-8665-fe95ac97f338 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: bbeb7a47-a8ee-44b3-bc79-bd12670aaa33] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:56:07.239461 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-4a8c1fc0-0db6-4def-8665-fe95ac97f338 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:07.240122 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-4a8c1fc0-0db6-4def-8665-fe95ac97f338 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:07.241162 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-4a8c1fc0-0db6-4def-8665-fe95ac97f338 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:07.241742 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-4a8c1fc0-0db6-4def-8665-fe95ac97f338 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:07.323773 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-4a8c1fc0-0db6-4def-8665-fe95ac97f338 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.106032 Apr 08 02:56:07.324418 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 482/962] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Apr 8 02:56:07 2022] GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33/os-volume_attachments => generated 25 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:56:07.456951 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-78666b3d-ed00-45d9-9417-529cab7e0b4b tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:07.457559 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-78666b3d-ed00-45d9-9417-529cab7e0b4b tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: bbeb7a47-a8ee-44b3-bc79-bd12670aaa33] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:56:07.468104 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-78666b3d-ed00-45d9-9417-529cab7e0b4b tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:07.468622 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-78666b3d-ed00-45d9-9417-529cab7e0b4b tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:07.469476 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-78666b3d-ed00-45d9-9417-529cab7e0b4b tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:07.469981 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-78666b3d-ed00-45d9-9417-529cab7e0b4b tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:07.546795 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-78666b3d-ed00-45d9-9417-529cab7e0b4b tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: bbeb7a47-a8ee-44b3-bc79-bd12670aaa33] Going to try to terminate instance {{(pid=96919) delete /opt/stack/nova/nova/compute/api.py:2559}} Apr 08 02:56:07.698205 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-78666b3d-ed00-45d9-9417-529cab7e0b4b tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "DELETE /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33" status: 204 len: 0 microversion: 2.20 time: 0.274627 Apr 08 02:56:07.699308 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 481/963] 10.222.0.48 () {60 vars in 1279 bytes} [Fri Apr 8 02:56:07 2022] DELETE /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 08 02:56:07.714194 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-cf3ac8b6-167b-4317-8796-cd6c69944e38 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:07.714715 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-cf3ac8b6-167b-4317-8796-cd6c69944e38 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: bbeb7a47-a8ee-44b3-bc79-bd12670aaa33] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:56:07.722581 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-cf3ac8b6-167b-4317-8796-cd6c69944e38 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:07.723397 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-cf3ac8b6-167b-4317-8796-cd6c69944e38 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:07.724483 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-cf3ac8b6-167b-4317-8796-cd6c69944e38 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:07.725282 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-cf3ac8b6-167b-4317-8796-cd6c69944e38 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:08.174923 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-cf3ac8b6-167b-4317-8796-cd6c69944e38 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:56:08.195531 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-cf3ac8b6-167b-4317-8796-cd6c69944e38 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:56:08.206859 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-cf3ac8b6-167b-4317-8796-cd6c69944e38 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:56:08.208680 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-cf3ac8b6-167b-4317-8796-cd6c69944e38 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33" status: 200 len: 1724 microversion: 2.20 time: 0.504409 Apr 08 02:56:08.218852 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 483/964] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:56:07 2022] GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33 => generated 1724 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:56:09.233614 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-62868588-85d8-4d39-af7e-72cde9b261de tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:09.234881 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-62868588-85d8-4d39-af7e-72cde9b261de tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: bbeb7a47-a8ee-44b3-bc79-bd12670aaa33] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:56:09.243448 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-62868588-85d8-4d39-af7e-72cde9b261de tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:09.243896 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-62868588-85d8-4d39-af7e-72cde9b261de tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:09.244686 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-62868588-85d8-4d39-af7e-72cde9b261de tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:09.245121 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-62868588-85d8-4d39-af7e-72cde9b261de tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:09.688423 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-62868588-85d8-4d39-af7e-72cde9b261de tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:56:09.708718 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-62868588-85d8-4d39-af7e-72cde9b261de tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:56:09.717581 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-62868588-85d8-4d39-af7e-72cde9b261de tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:56:09.719705 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-62868588-85d8-4d39-af7e-72cde9b261de tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33" status: 200 len: 1724 microversion: 2.20 time: 0.496350 Apr 08 02:56:09.732575 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 482/965] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:56:09 2022] GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33 => generated 1724 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:56:10.746869 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-39e63454-bff3-4663-83de-f8fa2efb5646 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:10.748585 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-39e63454-bff3-4663-83de-f8fa2efb5646 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: bbeb7a47-a8ee-44b3-bc79-bd12670aaa33] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:56:10.769603 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-39e63454-bff3-4663-83de-f8fa2efb5646 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:10.771792 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-39e63454-bff3-4663-83de-f8fa2efb5646 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:10.774164 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-39e63454-bff3-4663-83de-f8fa2efb5646 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:10.775566 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-39e63454-bff3-4663-83de-f8fa2efb5646 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:10.928725 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-39e63454-bff3-4663-83de-f8fa2efb5646 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:56:10.968557 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-39e63454-bff3-4663-83de-f8fa2efb5646 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:56:10.983576 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-39e63454-bff3-4663-83de-f8fa2efb5646 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:56:10.987355 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-39e63454-bff3-4663-83de-f8fa2efb5646 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33" status: 200 len: 1656 microversion: 2.20 time: 0.252806 Apr 08 02:56:10.990655 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 484/966] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:56:10 2022] GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33 => generated 1656 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 08 02:56:12.014066 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [req-867b2678-002c-413c-b07e-2663b2b8cbb6 req-df9e7d40-f80b-46bf-88fd-395174181da6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbeb7a47-a8ee-44b3-bc79-bd12670aaa33", "name": "network-vif-deleted", "tag": "2bd62dce-ca58-4c9e-bb8a-99411d102c48"}]} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:56:12.016866 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-d6c58744-438e-448c-a315-e57e0f254320 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:12.018406 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-d6c58744-438e-448c-a315-e57e0f254320 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: bbeb7a47-a8ee-44b3-bc79-bd12670aaa33] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:56:12.052217 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-d6c58744-438e-448c-a315-e57e0f254320 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:12.053089 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-d6c58744-438e-448c-a315-e57e0f254320 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:12.056459 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-d6c58744-438e-448c-a315-e57e0f254320 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:12.057196 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-d6c58744-438e-448c-a315-e57e0f254320 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:12.065424 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:56:12.065424 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: warnings.warn(msg) Apr 08 02:56:12.082653 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-867b2678-002c-413c-b07e-2663b2b8cbb6 req-df9e7d40-f80b-46bf-88fd-395174181da6 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:12.083509 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-867b2678-002c-413c-b07e-2663b2b8cbb6 req-df9e7d40-f80b-46bf-88fd-395174181da6 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:12.133209 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.compute.server_external_events [req-867b2678-002c-413c-b07e-2663b2b8cbb6 req-df9e7d40-f80b-46bf-88fd-395174181da6 service nova] Creating event network-vif-deleted:2bd62dce-ca58-4c9e-bb8a-99411d102c48 for instance bbeb7a47-a8ee-44b3-bc79-bd12670aaa33 on hv-cinder-83705 Apr 08 02:56:12.164390 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [req-867b2678-002c-413c-b07e-2663b2b8cbb6 req-df9e7d40-f80b-46bf-88fd-395174181da6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162786 Apr 08 02:56:12.171318 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 483/967] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:56:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:56:12.250219 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-d6c58744-438e-448c-a315-e57e0f254320 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:12.251150 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-d6c58744-438e-448c-a315-e57e0f254320 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:12.251974 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.objects.instance [None req-d6c58744-438e-448c-a315-e57e0f254320 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lazy-loading 'fault' on Instance uuid bbeb7a47-a8ee-44b3-bc79-bd12670aaa33 {{(pid=96920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 08 02:56:12.362555 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-d6c58744-438e-448c-a315-e57e0f254320 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:56:12.416348 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-d6c58744-438e-448c-a315-e57e0f254320 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:56:12.440936 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-d6c58744-438e-448c-a315-e57e0f254320 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7cf97b0aa15496393f1a39d5ef759de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673f0f0edd74c56a204930e93f143da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:56:12.450264 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-d6c58744-438e-448c-a315-e57e0f254320 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33" status: 200 len: 1371 microversion: 2.20 time: 0.448583 Apr 08 02:56:12.451131 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 485/968] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:56:12 2022] GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33 => generated 1371 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 08 02:56:13.478760 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-2d52ca98-942d-4092-904e-8f1abd4f34df tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:13.480152 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-2d52ca98-942d-4092-904e-8f1abd4f34df tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: bbeb7a47-a8ee-44b3-bc79-bd12670aaa33] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:56:13.488584 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-2d52ca98-942d-4092-904e-8f1abd4f34df tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:13.489658 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-2d52ca98-942d-4092-904e-8f1abd4f34df tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:13.490625 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-2d52ca98-942d-4092-904e-8f1abd4f34df tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:13.491264 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-2d52ca98-942d-4092-904e-8f1abd4f34df tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:13.545381 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.wsgi [None req-2d52ca98-942d-4092-904e-8f1abd4f34df tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] HTTP exception thrown: Instance bbeb7a47-a8ee-44b3-bc79-bd12670aaa33 could not be found. Apr 08 02:56:13.546299 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-2d52ca98-942d-4092-904e-8f1abd4f34df tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Returning 404 to user: Instance bbeb7a47-a8ee-44b3-bc79-bd12670aaa33 could not be found. {{(pid=96919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Apr 08 02:56:13.547369 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-2d52ca98-942d-4092-904e-8f1abd4f34df tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33" status: 404 len: 111 microversion: 2.20 time: 0.079140 Apr 08 02:56:13.548133 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 484/969] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:56:13 2022] GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 08 02:56:13.565005 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-2ba7cf8d-dcb4-4996-a6cd-3046fb1944fb tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '.version_select at 0x7f7d4e18fa60>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:13.595939 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-2ba7cf8d-dcb4-4996-a6cd-3046fb1944fb tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1443659673" status: 204 len: 0 microversion: 2.20 time: 0.042086 Apr 08 02:56:13.596625 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 486/970] 10.222.0.48 () {60 vars in 1261 bytes} [Fri Apr 8 02:56:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1443659673 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 08 02:56:15.170622 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-e7cda863-e9cd-4d81-b0e1-b29b62bdb731 tempest-VolumesTestJSON-1168531192 tempest-VolumesTestJSON-1168531192-project] Calling method '.version_select at 0x7f7d4e31fb80>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:15.264826 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-e7cda863-e9cd-4d81-b0e1-b29b62bdb731 tempest-VolumesTestJSON-1168531192 tempest-VolumesTestJSON-1168531192-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/e17fb1b2-8fe2-4179-85d8-3a1937f0ae72" status: 200 len: 351 microversion: 2.1 time: 0.105044 Apr 08 02:56:15.265681 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 485/971] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Apr 8 02:56:15 2022] GET /compute/v2.1/os-volumes/e17fb1b2-8fe2-4179-85d8-3a1937f0ae72 => generated 351 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:56:16.938085 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-3d403801-2d75-4d53-bffb-7207f746d1c6 tempest-VolumesTestJSON-1168531192 tempest-VolumesTestJSON-1168531192-project] Calling method '.version_select at 0x7f7d4e07d700>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:17.043912 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-3d403801-2d75-4d53-bffb-7207f746d1c6 tempest-VolumesTestJSON-1168531192 tempest-VolumesTestJSON-1168531192-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/78cd481d-c432-4dfc-89a0-bad90f63d8e1" status: 200 len: 351 microversion: 2.1 time: 0.115730 Apr 08 02:56:17.044471 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 487/972] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Apr 8 02:56:16 2022] GET /compute/v2.1/os-volumes/78cd481d-c432-4dfc-89a0-bad90f63d8e1 => generated 351 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:56:17.423492 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-c085e51d-6e8e-4b16-b1a4-a8821fb723e8 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:17.423492 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-c085e51d-6e8e-4b16-b1a4-a8821fb723e8 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: bbeb7a47-a8ee-44b3-bc79-bd12670aaa33] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:56:17.430480 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-c085e51d-6e8e-4b16-b1a4-a8821fb723e8 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:17.430966 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-c085e51d-6e8e-4b16-b1a4-a8821fb723e8 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:17.431790 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-c085e51d-6e8e-4b16-b1a4-a8821fb723e8 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:17.432218 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-c085e51d-6e8e-4b16-b1a4-a8821fb723e8 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:17.487808 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.wsgi [None req-c085e51d-6e8e-4b16-b1a4-a8821fb723e8 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] HTTP exception thrown: Instance bbeb7a47-a8ee-44b3-bc79-bd12670aaa33 could not be found. Apr 08 02:56:17.489563 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-c085e51d-6e8e-4b16-b1a4-a8821fb723e8 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Returning 404 to user: Instance bbeb7a47-a8ee-44b3-bc79-bd12670aaa33 could not be found. {{(pid=96919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Apr 08 02:56:17.490399 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-c085e51d-6e8e-4b16-b1a4-a8821fb723e8 tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "DELETE /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33" status: 404 len: 111 microversion: 2.20 time: 0.081014 Apr 08 02:56:17.498758 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 486/973] 10.222.0.48 () {60 vars in 1279 bytes} [Fri Apr 8 02:56:17 2022] DELETE /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 08 02:56:17.505344 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-a951a5e4-c842-4878-b3c3-0d82f801d96b tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:17.505944 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-a951a5e4-c842-4878-b3c3-0d82f801d96b tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: bbeb7a47-a8ee-44b3-bc79-bd12670aaa33] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:56:17.515741 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-a951a5e4-c842-4878-b3c3-0d82f801d96b tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:17.516195 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-a951a5e4-c842-4878-b3c3-0d82f801d96b tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:17.516972 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-a951a5e4-c842-4878-b3c3-0d82f801d96b tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:17.517398 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-a951a5e4-c842-4878-b3c3-0d82f801d96b tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:17.568941 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.wsgi [None req-a951a5e4-c842-4878-b3c3-0d82f801d96b tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] HTTP exception thrown: Instance bbeb7a47-a8ee-44b3-bc79-bd12670aaa33 could not be found. Apr 08 02:56:17.569689 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-a951a5e4-c842-4878-b3c3-0d82f801d96b tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Returning 404 to user: Instance bbeb7a47-a8ee-44b3-bc79-bd12670aaa33 could not be found. {{(pid=96920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Apr 08 02:56:17.570649 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-a951a5e4-c842-4878-b3c3-0d82f801d96b tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33" status: 404 len: 111 microversion: 2.20 time: 0.075046 Apr 08 02:56:17.571273 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 488/974] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:56:17 2022] GET /compute/v2.1/servers/bbeb7a47-a8ee-44b3-bc79-bd12670aaa33 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 08 02:56:18.525117 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-29e9e3ce-d2eb-4a10-b6d7-f96825673c27 tempest-VolumesTestJSON-1168531192 tempest-VolumesTestJSON-1168531192-project] Calling method '.version_select at 0x7f7d4e474820>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:18.638315 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-29e9e3ce-d2eb-4a10-b6d7-f96825673c27 tempest-VolumesTestJSON-1168531192 tempest-VolumesTestJSON-1168531192-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/27d63c22-5db2-4b64-9907-54f65b8e009c" status: 200 len: 351 microversion: 2.1 time: 0.123344 Apr 08 02:56:18.639108 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 487/975] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Apr 8 02:56:18 2022] GET /compute/v2.1/os-volumes/27d63c22-5db2-4b64-9907-54f65b8e009c => generated 351 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:56:18.656495 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-428bf2e7-83f2-4bbc-8f9e-6db8227fc8ef tempest-VolumesTestJSON-1168531192 tempest-VolumesTestJSON-1168531192-project] Calling method '.version_select at 0x7f7d4e571d30>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:18.749767 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-428bf2e7-83f2-4bbc-8f9e-6db8227fc8ef tempest-VolumesTestJSON-1168531192 tempest-VolumesTestJSON-1168531192-project] 10.222.0.48 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.102874 Apr 08 02:56:18.750516 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 489/976] 10.222.0.48 () {58 vars in 1133 bytes} [Fri Apr 8 02:56:18 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:56:18.769939 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-579ff488-7852-43a7-87ef-faa4d5856f86 tempest-VolumesTestJSON-1168531192 tempest-VolumesTestJSON-1168531192-project] Calling method '.version_select at 0x7f7d4e2ec160>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:18.823464 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-d52cfb44-fa77-4a45-b096-f4f247e491eb tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:18.824214 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-d52cfb44-fa77-4a45-b096-f4f247e491eb tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:56:18.833082 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-d52cfb44-fa77-4a45-b096-f4f247e491eb tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:18.833780 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-d52cfb44-fa77-4a45-b096-f4f247e491eb tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:18.834566 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-d52cfb44-fa77-4a45-b096-f4f247e491eb tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:18.835096 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-d52cfb44-fa77-4a45-b096-f4f247e491eb tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:18.872432 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-579ff488-7852-43a7-87ef-faa4d5856f86 tempest-VolumesTestJSON-1168531192 tempest-VolumesTestJSON-1168531192-project] 10.222.0.48 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.112731 Apr 08 02:56:18.873199 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 488/977] 10.222.0.48 () {58 vars in 1148 bytes} [Fri Apr 8 02:56:18 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:56:18.887062 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.wsgi [None req-d52cfb44-fa77-4a45-b096-f4f247e491eb tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] HTTP exception thrown: Instance e44bc1d2-0741-4081-9165-b0aca9008eaf could not be found. Apr 08 02:56:18.888048 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-d52cfb44-fa77-4a45-b096-f4f247e491eb tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Returning 404 to user: Instance e44bc1d2-0741-4081-9165-b0aca9008eaf could not be found. {{(pid=96920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Apr 08 02:56:18.888980 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-d52cfb44-fa77-4a45-b096-f4f247e491eb tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 404 len: 111 microversion: 2.20 time: 0.074611 Apr 08 02:56:18.889653 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 490/978] 10.222.0.48 () {60 vars in 1279 bytes} [Fri Apr 8 02:56:18 2022] DELETE /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Apr 08 02:56:18.892310 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-34f5d38b-66bc-43ff-adc9-bfdb38e194a2 tempest-VolumesTestJSON-1168531192 tempest-VolumesTestJSON-1168531192-project] Calling method '.version_select at 0x7f7d4e396670>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:18.904268 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-9a83df66-1844-4a8b-94c8-b3d8f10c93be tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:18.905009 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-9a83df66-1844-4a8b-94c8-b3d8f10c93be tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] [instance: e44bc1d2-0741-4081-9165-b0aca9008eaf] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:56:18.913666 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-9a83df66-1844-4a8b-94c8-b3d8f10c93be tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:18.914254 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-9a83df66-1844-4a8b-94c8-b3d8f10c93be tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:18.915217 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-9a83df66-1844-4a8b-94c8-b3d8f10c93be tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:18.915832 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-9a83df66-1844-4a8b-94c8-b3d8f10c93be tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:18.972336 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.wsgi [None req-9a83df66-1844-4a8b-94c8-b3d8f10c93be tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] HTTP exception thrown: Instance e44bc1d2-0741-4081-9165-b0aca9008eaf could not be found. Apr 08 02:56:18.973769 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-9a83df66-1844-4a8b-94c8-b3d8f10c93be tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] Returning 404 to user: Instance e44bc1d2-0741-4081-9165-b0aca9008eaf could not be found. {{(pid=96920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Apr 08 02:56:18.975187 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-9a83df66-1844-4a8b-94c8-b3d8f10c93be tempest-AttachVolumeShelveTestJSON-2100961107 tempest-AttachVolumeShelveTestJSON-2100961107-project] 10.222.0.48 "GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf" status: 404 len: 111 microversion: 2.20 time: 0.081327 Apr 08 02:56:18.980107 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 491/979] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Apr 8 02:56:18 2022] GET /compute/v2.1/servers/e44bc1d2-0741-4081-9165-b0aca9008eaf => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 08 02:56:19.172015 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-34f5d38b-66bc-43ff-adc9-bfdb38e194a2 tempest-VolumesTestJSON-1168531192 tempest-VolumesTestJSON-1168531192-project] 10.222.0.48 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.290068 Apr 08 02:56:19.172599 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 489/980] 10.222.0.48 () {58 vars in 1133 bytes} [Fri Apr 8 02:56:18 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:56:19.189439 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-8bc46f9d-c752-47cf-baa5-149a479f7990 tempest-VolumesTestJSON-1168531192 tempest-VolumesTestJSON-1168531192-project] Calling method '.version_select at 0x7f7d4e2afca0>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:19.281859 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-8bc46f9d-c752-47cf-baa5-149a479f7990 tempest-VolumesTestJSON-1168531192 tempest-VolumesTestJSON-1168531192-project] 10.222.0.48 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.101777 Apr 08 02:56:19.283827 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 492/981] 10.222.0.48 () {58 vars in 1166 bytes} [Fri Apr 8 02:56:19 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:56:19.304052 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-ab6aadaf-b6b4-4a94-9418-4abd86ade863 tempest-VolumesTestJSON-1168531192 tempest-VolumesTestJSON-1168531192-project] Calling method '.version_select at 0x7f7d4e396af0>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:19.411585 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-ab6aadaf-b6b4-4a94-9418-4abd86ade863 tempest-VolumesTestJSON-1168531192 tempest-VolumesTestJSON-1168531192-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.117743 Apr 08 02:56:19.412147 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 490/982] 10.222.0.48 () {58 vars in 1169 bytes} [Fri Apr 8 02:56:19 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:56:19.429369 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-2a75bf8f-291f-4f38-ba7c-1b9961d3991f tempest-VolumesTestJSON-1168531192 tempest-VolumesTestJSON-1168531192-project] Calling method '.version_select at 0x7f7d4e07dee0>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:19.536254 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-2a75bf8f-291f-4f38-ba7c-1b9961d3991f tempest-VolumesTestJSON-1168531192 tempest-VolumesTestJSON-1168531192-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.115250 Apr 08 02:56:19.537043 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 493/983] 10.222.0.48 () {58 vars in 1154 bytes} [Fri Apr 8 02:56:19 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:56:19.557578 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-d670edf7-9218-4be3-a48e-5f79e6d38808 tempest-VolumesTestJSON-1168531192 tempest-VolumesTestJSON-1168531192-project] Calling method '.version_select at 0x7f7d4e5a9a60>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:19.690396 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-d670edf7-9218-4be3-a48e-5f79e6d38808 tempest-VolumesTestJSON-1168531192 tempest-VolumesTestJSON-1168531192-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.142481 Apr 08 02:56:19.697763 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 491/984] 10.222.0.48 () {58 vars in 1187 bytes} [Fri Apr 8 02:56:19 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:56:19.708252 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-6f4a676d-81c3-4ef1-9251-9953f3cd339c tempest-VolumesTestJSON-1168531192 tempest-VolumesTestJSON-1168531192-project] Calling method '.version_select at 0x7f7d4e0891f0>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:19.816360 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-6f4a676d-81c3-4ef1-9251-9953f3cd339c tempest-VolumesTestJSON-1168531192 tempest-VolumesTestJSON-1168531192-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.117697 Apr 08 02:56:19.817929 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 494/985] 10.222.0.48 () {58 vars in 1154 bytes} [Fri Apr 8 02:56:19 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:56:23.650874 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-b6259359-798a-4343-b8e9-2028b49d9170 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Action: 'create', calling method: .version_select at 0x7f7d4e5a9820>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1851240614"}} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:56:23.677696 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.quota [None req-b6259359-798a-4343-b8e9-2028b49d9170 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Getting quotas for project c89cf122bfb64dbca81527f5cac790a5. Resources: {'key_pairs'} {{(pid=96919) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:56:23.681615 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.quota [None req-b6259359-798a-4343-b8e9-2028b49d9170 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Getting quotas for user 6d94e2a615ab42aaa79b7c8470f7808a and project c89cf122bfb64dbca81527f5cac790a5. Resources: {'key_pairs'} {{(pid=96919) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:56:23.912324 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.quota [None req-b6259359-798a-4343-b8e9-2028b49d9170 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Getting quotas for project c89cf122bfb64dbca81527f5cac790a5. Resources: {'key_pairs'} {{(pid=96919) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:56:23.916103 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.quota [None req-b6259359-798a-4343-b8e9-2028b49d9170 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Getting quotas for user 6d94e2a615ab42aaa79b7c8470f7808a and project c89cf122bfb64dbca81527f5cac790a5. Resources: {'key_pairs'} {{(pid=96919) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:56:23.932493 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-b6259359-798a-4343-b8e9-2028b49d9170 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.528170 Apr 08 02:56:23.933617 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 492/986] 10.222.0.48 () {60 vars in 1157 bytes} [Fri Apr 8 02:56:23 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:56:49.621396 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 08 02:56:49.622005 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: Fri Apr 8 02:56:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.48) !!! Apr 08 02:56:49.647159 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-d9bbae01-9b74-4079-9008-5e1d06131079 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-279739885", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1851240614", "security_groups": [{"name": "tempest-secgroup-smoke-2042401346"}], "block_device_mapping_v2": [{"uuid": "70ea1c94-12b9-4478-8cff-7ed4bb2a87dd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ae66bd3d-676a-4225-963c-1a0fd3518d06"}]}} {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:56:49.888403 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.network.neutron [None req-d9bbae01-9b74-4079-9008-5e1d06131079 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] validate_networks() for [('ae66bd3d-676a-4225-963c-1a0fd3518d06', None, None, None)] {{(pid=96920) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} Apr 08 02:56:50.865194 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.virt.hardware [None req-d9bbae01-9b74-4079-9008-5e1d06131079 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Flavor limits 0:0:0 {{(pid=96920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} Apr 08 02:56:50.865798 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.virt.hardware [None req-d9bbae01-9b74-4079-9008-5e1d06131079 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Image limits 0:0:0 {{(pid=96920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} Apr 08 02:56:50.866080 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.virt.hardware [None req-d9bbae01-9b74-4079-9008-5e1d06131079 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Flavor pref 0:0:0 {{(pid=96920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} Apr 08 02:56:50.866476 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.virt.hardware [None req-d9bbae01-9b74-4079-9008-5e1d06131079 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Image pref 0:0:0 {{(pid=96920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} Apr 08 02:56:50.866916 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.virt.hardware [None req-d9bbae01-9b74-4079-9008-5e1d06131079 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=96920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} Apr 08 02:56:50.875047 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-d9bbae01-9b74-4079-9008-5e1d06131079 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:50.875481 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-d9bbae01-9b74-4079-9008-5e1d06131079 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:50.876264 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-d9bbae01-9b74-4079-9008-5e1d06131079 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:50.876680 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-d9bbae01-9b74-4079-9008-5e1d06131079 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:50.893840 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.quota [None req-d9bbae01-9b74-4079-9008-5e1d06131079 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Getting quotas for project c89cf122bfb64dbca81527f5cac790a5. Resources: {'instances', 'cores', 'ram'} {{(pid=96920) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:56:50.898070 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.quota [None req-d9bbae01-9b74-4079-9008-5e1d06131079 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Getting quotas for user 6d94e2a615ab42aaa79b7c8470f7808a and project c89cf122bfb64dbca81527f5cac790a5. Resources: {'instances', 'cores', 'ram'} {{(pid=96920) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:56:50.985500 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-d9bbae01-9b74-4079-9008-5e1d06131079 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Going to run 1 instances... {{(pid=96920) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} Apr 08 02:56:50.987653 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-d9bbae01-9b74-4079-9008-5e1d06131079 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] [instance: db095363-7817-4713-9eb0-3bcda511112e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='70ea1c94-12b9-4478-8cff-7ed4bb2a87dd',volume_size=None,volume_type=None)] {{(pid=96920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} Apr 08 02:56:51.287504 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-d9bbae01-9b74-4079-9008-5e1d06131079 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.667648 Apr 08 02:56:51.288702 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 495/987] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Apr 8 02:56:49 2022] POST /compute/v2.1/servers => generated 406 bytes in 1670 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 08 02:56:51.305046 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-4d551677-7d3d-4055-9807-523ee17d2817 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:51.305659 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-4d551677-7d3d-4055-9807-523ee17d2817 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] [instance: db095363-7817-4713-9eb0-3bcda511112e] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:56:51.393338 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-4d551677-7d3d-4055-9807-523ee17d2817 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d94e2a615ab42aaa79b7c8470f7808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89cf122bfb64dbca81527f5cac790a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:56:51.406787 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-4d551677-7d3d-4055-9807-523ee17d2817 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] 10.222.0.48 "GET /compute/v2.1/servers/db095363-7817-4713-9eb0-3bcda511112e" status: 200 len: 1094 microversion: 2.1 time: 0.112486 Apr 08 02:56:51.407345 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 493/988] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:56:51 2022] GET /compute/v2.1/servers/db095363-7817-4713-9eb0-3bcda511112e => generated 1094 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:56:51.763926 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-4c60e842-5898-4ff4-aa14-2199199b6608 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2102427955", "imageRef": "7f8ca061-f382-4052-8d05-69f37e107684", "flavorRef": "452", "networks": [{"uuid": "5c550fb9-4d2f-42b9-9101-9100317842af"}]}} {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:56:51.838359 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.network.neutron [None req-4c60e842-5898-4ff4-aa14-2199199b6608 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] validate_networks() for [('5c550fb9-4d2f-42b9-9101-9100317842af', None, None, None)] {{(pid=96920) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} Apr 08 02:56:52.354727 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.virt.hardware [None req-4c60e842-5898-4ff4-aa14-2199199b6608 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Flavor limits 0:0:0 {{(pid=96920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} Apr 08 02:56:52.356156 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.virt.hardware [None req-4c60e842-5898-4ff4-aa14-2199199b6608 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Image limits 0:0:0 {{(pid=96920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} Apr 08 02:56:52.356676 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.virt.hardware [None req-4c60e842-5898-4ff4-aa14-2199199b6608 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Flavor pref 0:0:0 {{(pid=96920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} Apr 08 02:56:52.357239 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.virt.hardware [None req-4c60e842-5898-4ff4-aa14-2199199b6608 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Image pref 0:0:0 {{(pid=96920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} Apr 08 02:56:52.357819 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.virt.hardware [None req-4c60e842-5898-4ff4-aa14-2199199b6608 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=96920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} Apr 08 02:56:52.367618 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-4c60e842-5898-4ff4-aa14-2199199b6608 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:52.368392 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-4c60e842-5898-4ff4-aa14-2199199b6608 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:52.369083 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-4c60e842-5898-4ff4-aa14-2199199b6608 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:52.369510 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-4c60e842-5898-4ff4-aa14-2199199b6608 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:52.396126 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.quota [None req-4c60e842-5898-4ff4-aa14-2199199b6608 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Getting quotas for project 808cc1b3def14c1f8ea4f6635967b351. Resources: {'instances', 'cores', 'ram'} {{(pid=96920) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:56:52.396126 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.quota [None req-4c60e842-5898-4ff4-aa14-2199199b6608 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Getting quotas for user 31758734d70b471081c8262b0492bc56 and project 808cc1b3def14c1f8ea4f6635967b351. Resources: {'instances', 'cores', 'ram'} {{(pid=96920) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:56:52.403099 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-4c60e842-5898-4ff4-aa14-2199199b6608 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Going to run 1 instances... {{(pid=96920) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} Apr 08 02:56:52.405296 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-4c60e842-5898-4ff4-aa14-2199199b6608 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] [instance: cd58846b-cc10-48d8-9a05-8c893d7cd80d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7f8ca061-f382-4052-8d05-69f37e107684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=96920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} Apr 08 02:56:52.434006 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-cfe9836e-ece2-40b5-ac1a-2002c46a2a8a tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:52.435511 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-cfe9836e-ece2-40b5-ac1a-2002c46a2a8a tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] [instance: db095363-7817-4713-9eb0-3bcda511112e] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:56:52.444004 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-cfe9836e-ece2-40b5-ac1a-2002c46a2a8a tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:52.445345 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-cfe9836e-ece2-40b5-ac1a-2002c46a2a8a tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:52.446494 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-cfe9836e-ece2-40b5-ac1a-2002c46a2a8a tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:52.447054 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-cfe9836e-ece2-40b5-ac1a-2002c46a2a8a tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:52.474246 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-4c60e842-5898-4ff4-aa14-2199199b6608 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.721607 Apr 08 02:56:52.475362 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 496/989] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Apr 8 02:56:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 08 02:56:52.491902 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-0f065834-c54a-4825-a167-b6e9a2af4a94 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:52.493325 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-0f065834-c54a-4825-a167-b6e9a2af4a94 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] [instance: cd58846b-cc10-48d8-9a05-8c893d7cd80d] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:56:52.575990 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-0f065834-c54a-4825-a167-b6e9a2af4a94 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31758734d70b471081c8262b0492bc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc1b3def14c1f8ea4f6635967b351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:56:52.598192 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-0f065834-c54a-4825-a167-b6e9a2af4a94 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] 10.222.0.48 "GET /compute/v2.1/servers/cd58846b-cc10-48d8-9a05-8c893d7cd80d" status: 200 len: 1214 microversion: 2.1 time: 0.116371 Apr 08 02:56:52.599597 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 497/990] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:56:52 2022] GET /compute/v2.1/servers/cd58846b-cc10-48d8-9a05-8c893d7cd80d => generated 1214 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:56:52.651556 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-cfe9836e-ece2-40b5-ac1a-2002c46a2a8a tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d94e2a615ab42aaa79b7c8470f7808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89cf122bfb64dbca81527f5cac790a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:56:52.663091 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-cfe9836e-ece2-40b5-ac1a-2002c46a2a8a tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] 10.222.0.48 "GET /compute/v2.1/servers/db095363-7817-4713-9eb0-3bcda511112e" status: 200 len: 1192 microversion: 2.1 time: 0.242238 Apr 08 02:56:52.664206 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 494/991] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:56:52 2022] GET /compute/v2.1/servers/db095363-7817-4713-9eb0-3bcda511112e => generated 1192 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:56:53.627527 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-290f4da6-32f4-4b22-9df7-1b5af16befca tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:53.629072 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-290f4da6-32f4-4b22-9df7-1b5af16befca tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] [instance: cd58846b-cc10-48d8-9a05-8c893d7cd80d] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:56:53.638918 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-290f4da6-32f4-4b22-9df7-1b5af16befca tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:53.639445 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-290f4da6-32f4-4b22-9df7-1b5af16befca tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:53.640288 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-290f4da6-32f4-4b22-9df7-1b5af16befca tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:53.640827 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-290f4da6-32f4-4b22-9df7-1b5af16befca tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:53.687474 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-4fbc8510-c84e-467b-9b2c-e4c5f96c5678 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:53.688771 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-4fbc8510-c84e-467b-9b2c-e4c5f96c5678 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] [instance: db095363-7817-4713-9eb0-3bcda511112e] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:56:53.700834 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-4fbc8510-c84e-467b-9b2c-e4c5f96c5678 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:53.701693 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-4fbc8510-c84e-467b-9b2c-e4c5f96c5678 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:53.702899 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-4fbc8510-c84e-467b-9b2c-e4c5f96c5678 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:53.704077 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-4fbc8510-c84e-467b-9b2c-e4c5f96c5678 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:53.908430 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-290f4da6-32f4-4b22-9df7-1b5af16befca tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31758734d70b471081c8262b0492bc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc1b3def14c1f8ea4f6635967b351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:56:53.919245 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-290f4da6-32f4-4b22-9df7-1b5af16befca tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] 10.222.0.48 "GET /compute/v2.1/servers/cd58846b-cc10-48d8-9a05-8c893d7cd80d" status: 200 len: 1274 microversion: 2.1 time: 0.306892 Apr 08 02:56:53.920358 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 498/992] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:56:53 2022] GET /compute/v2.1/servers/cd58846b-cc10-48d8-9a05-8c893d7cd80d => generated 1274 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:56:54.039329 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-4fbc8510-c84e-467b-9b2c-e4c5f96c5678 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d94e2a615ab42aaa79b7c8470f7808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89cf122bfb64dbca81527f5cac790a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:56:54.048649 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-4fbc8510-c84e-467b-9b2c-e4c5f96c5678 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] 10.222.0.48 "GET /compute/v2.1/servers/db095363-7817-4713-9eb0-3bcda511112e" status: 200 len: 1266 microversion: 2.1 time: 0.371300 Apr 08 02:56:54.055039 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 495/993] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:56:53 2022] GET /compute/v2.1/servers/db095363-7817-4713-9eb0-3bcda511112e => generated 1266 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:56:54.942538 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-7ab2c7c1-ea19-494f-b144-3d193adba7eb tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:54.943350 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-7ab2c7c1-ea19-494f-b144-3d193adba7eb tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] [instance: cd58846b-cc10-48d8-9a05-8c893d7cd80d] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:56:54.950892 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-7ab2c7c1-ea19-494f-b144-3d193adba7eb tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:54.951422 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-7ab2c7c1-ea19-494f-b144-3d193adba7eb tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:54.952264 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-7ab2c7c1-ea19-494f-b144-3d193adba7eb tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:54.952756 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-7ab2c7c1-ea19-494f-b144-3d193adba7eb tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:55.071786 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-d9a78691-0e0e-4f92-85fe-bf1a7da81f0f tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:55.073032 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-d9a78691-0e0e-4f92-85fe-bf1a7da81f0f tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] [instance: db095363-7817-4713-9eb0-3bcda511112e] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:56:55.082902 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-d9a78691-0e0e-4f92-85fe-bf1a7da81f0f tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:55.083693 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-d9a78691-0e0e-4f92-85fe-bf1a7da81f0f tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:55.084649 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-d9a78691-0e0e-4f92-85fe-bf1a7da81f0f tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:55.085692 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-d9a78691-0e0e-4f92-85fe-bf1a7da81f0f tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:55.100288 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-7ab2c7c1-ea19-494f-b144-3d193adba7eb tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31758734d70b471081c8262b0492bc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc1b3def14c1f8ea4f6635967b351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:56:55.109560 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-7ab2c7c1-ea19-494f-b144-3d193adba7eb tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] 10.222.0.48 "GET /compute/v2.1/servers/cd58846b-cc10-48d8-9a05-8c893d7cd80d" status: 200 len: 1272 microversion: 2.1 time: 0.176229 Apr 08 02:56:55.110760 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 499/994] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:56:54 2022] GET /compute/v2.1/servers/cd58846b-cc10-48d8-9a05-8c893d7cd80d => generated 1272 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:56:55.301269 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-d9a78691-0e0e-4f92-85fe-bf1a7da81f0f tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d94e2a615ab42aaa79b7c8470f7808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89cf122bfb64dbca81527f5cac790a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:56:55.309482 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-d9a78691-0e0e-4f92-85fe-bf1a7da81f0f tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] 10.222.0.48 "GET /compute/v2.1/servers/db095363-7817-4713-9eb0-3bcda511112e" status: 200 len: 1266 microversion: 2.1 time: 0.247903 Apr 08 02:56:55.310349 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 496/995] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:56:55 2022] GET /compute/v2.1/servers/db095363-7817-4713-9eb0-3bcda511112e => generated 1266 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:56:55.715029 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [req-a12d188d-8747-421e-b83c-2eb676f3b580 req-f928790d-71c8-464b-a303-6843cf740a36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db095363-7817-4713-9eb0-3bcda511112e", "tag": "1ff823af-42f9-4594-93e9-62f6e5e8c8b1"}]} {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:56:55.723876 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:56:55.723876 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: warnings.warn(msg) Apr 08 02:56:55.732949 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-a12d188d-8747-421e-b83c-2eb676f3b580 req-f928790d-71c8-464b-a303-6843cf740a36 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:55.737717 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-a12d188d-8747-421e-b83c-2eb676f3b580 req-f928790d-71c8-464b-a303-6843cf740a36 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:55.756406 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.compute.server_external_events [req-a12d188d-8747-421e-b83c-2eb676f3b580 req-f928790d-71c8-464b-a303-6843cf740a36 service nova] Creating event network-changed:1ff823af-42f9-4594-93e9-62f6e5e8c8b1 for instance db095363-7817-4713-9eb0-3bcda511112e on hv-cinder-83705 Apr 08 02:56:55.763124 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [req-a12d188d-8747-421e-b83c-2eb676f3b580 req-f928790d-71c8-464b-a303-6843cf740a36 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058083 Apr 08 02:56:55.764423 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 500/996] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:56:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 02:56:56.133721 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-03e1d973-49d6-4cb9-90ed-1e598a9ad476 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:56.134336 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-03e1d973-49d6-4cb9-90ed-1e598a9ad476 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] [instance: cd58846b-cc10-48d8-9a05-8c893d7cd80d] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:56:56.141859 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-03e1d973-49d6-4cb9-90ed-1e598a9ad476 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:56.142539 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-03e1d973-49d6-4cb9-90ed-1e598a9ad476 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:56.143522 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-03e1d973-49d6-4cb9-90ed-1e598a9ad476 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:56.144499 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-03e1d973-49d6-4cb9-90ed-1e598a9ad476 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:56.334694 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-6cc13e15-e103-4193-a840-a7c2185a0dde tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:56.335562 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-6cc13e15-e103-4193-a840-a7c2185a0dde tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] [instance: db095363-7817-4713-9eb0-3bcda511112e] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:56:56.343699 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-6cc13e15-e103-4193-a840-a7c2185a0dde tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:56.344233 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-6cc13e15-e103-4193-a840-a7c2185a0dde tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:56.345104 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-6cc13e15-e103-4193-a840-a7c2185a0dde tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:56.345778 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-6cc13e15-e103-4193-a840-a7c2185a0dde tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:56.432602 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-03e1d973-49d6-4cb9-90ed-1e598a9ad476 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31758734d70b471081c8262b0492bc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc1b3def14c1f8ea4f6635967b351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:56:56.440738 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-03e1d973-49d6-4cb9-90ed-1e598a9ad476 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] 10.222.0.48 "GET /compute/v2.1/servers/cd58846b-cc10-48d8-9a05-8c893d7cd80d" status: 200 len: 1314 microversion: 2.1 time: 0.317098 Apr 08 02:56:56.449671 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 497/997] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:56:56 2022] GET /compute/v2.1/servers/cd58846b-cc10-48d8-9a05-8c893d7cd80d => generated 1314 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:56:56.689908 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-6cc13e15-e103-4193-a840-a7c2185a0dde tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d94e2a615ab42aaa79b7c8470f7808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89cf122bfb64dbca81527f5cac790a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:56:56.698927 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-6cc13e15-e103-4193-a840-a7c2185a0dde tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] 10.222.0.48 "GET /compute/v2.1/servers/db095363-7817-4713-9eb0-3bcda511112e" status: 200 len: 1266 microversion: 2.1 time: 0.375777 Apr 08 02:56:56.699569 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 501/998] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:56:56 2022] GET /compute/v2.1/servers/db095363-7817-4713-9eb0-3bcda511112e => generated 1266 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:56:57.462503 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-b4cc172c-a1c2-455f-9686-4ff43de3de2e tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:57.463149 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-b4cc172c-a1c2-455f-9686-4ff43de3de2e tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] [instance: cd58846b-cc10-48d8-9a05-8c893d7cd80d] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:56:57.470232 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b4cc172c-a1c2-455f-9686-4ff43de3de2e tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:57.470686 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b4cc172c-a1c2-455f-9686-4ff43de3de2e tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:57.471480 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b4cc172c-a1c2-455f-9686-4ff43de3de2e tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:57.472432 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b4cc172c-a1c2-455f-9686-4ff43de3de2e tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:57.683010 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-b4cc172c-a1c2-455f-9686-4ff43de3de2e tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31758734d70b471081c8262b0492bc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc1b3def14c1f8ea4f6635967b351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:56:57.691029 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-b4cc172c-a1c2-455f-9686-4ff43de3de2e tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] 10.222.0.48 "GET /compute/v2.1/servers/cd58846b-cc10-48d8-9a05-8c893d7cd80d" status: 200 len: 1314 microversion: 2.1 time: 0.237683 Apr 08 02:56:57.691672 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 498/999] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:56:57 2022] GET /compute/v2.1/servers/cd58846b-cc10-48d8-9a05-8c893d7cd80d => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:56:57.723257 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-3606dd52-d2de-411c-aa2c-463cbbede8a7 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:57.723713 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-3606dd52-d2de-411c-aa2c-463cbbede8a7 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] [instance: db095363-7817-4713-9eb0-3bcda511112e] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:56:57.730830 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-3606dd52-d2de-411c-aa2c-463cbbede8a7 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:57.731276 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-3606dd52-d2de-411c-aa2c-463cbbede8a7 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:57.732039 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-3606dd52-d2de-411c-aa2c-463cbbede8a7 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:57.732462 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-3606dd52-d2de-411c-aa2c-463cbbede8a7 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:57.817356 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [req-a62c8fac-5ec2-4a2a-bbf6-a4cc444e2501 req-18a541be-e5bc-41f5-82c6-9f92c69aba03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd58846b-cc10-48d8-9a05-8c893d7cd80d", "tag": "c7346b5f-ce63-42a6-a172-73865f9b3a74"}]} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:56:57.823558 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:56:57.823558 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: warnings.warn(msg) Apr 08 02:56:57.832182 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-a62c8fac-5ec2-4a2a-bbf6-a4cc444e2501 req-18a541be-e5bc-41f5-82c6-9f92c69aba03 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:57.832618 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-a62c8fac-5ec2-4a2a-bbf6-a4cc444e2501 req-18a541be-e5bc-41f5-82c6-9f92c69aba03 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:57.849304 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.compute.server_external_events [req-a62c8fac-5ec2-4a2a-bbf6-a4cc444e2501 req-18a541be-e5bc-41f5-82c6-9f92c69aba03 service nova] Creating event network-changed:c7346b5f-ce63-42a6-a172-73865f9b3a74 for instance cd58846b-cc10-48d8-9a05-8c893d7cd80d on hv-cinder-83705 Apr 08 02:56:57.854359 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [req-a62c8fac-5ec2-4a2a-bbf6-a4cc444e2501 req-18a541be-e5bc-41f5-82c6-9f92c69aba03 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045840 Apr 08 02:56:57.855313 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 499/1000] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:56:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:56:57.939912 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-3606dd52-d2de-411c-aa2c-463cbbede8a7 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d94e2a615ab42aaa79b7c8470f7808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89cf122bfb64dbca81527f5cac790a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:56:57.950003 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-3606dd52-d2de-411c-aa2c-463cbbede8a7 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] 10.222.0.48 "GET /compute/v2.1/servers/db095363-7817-4713-9eb0-3bcda511112e" status: 200 len: 1266 microversion: 2.1 time: 0.236589 Apr 08 02:56:57.950551 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 502/1001] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:56:57 2022] GET /compute/v2.1/servers/db095363-7817-4713-9eb0-3bcda511112e => generated 1266 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:56:58.717111 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-8993237c-b9b1-4cde-ae96-4c2c3a761122 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:58.717111 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-8993237c-b9b1-4cde-ae96-4c2c3a761122 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] [instance: cd58846b-cc10-48d8-9a05-8c893d7cd80d] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:56:58.723868 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-8993237c-b9b1-4cde-ae96-4c2c3a761122 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:58.724413 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-8993237c-b9b1-4cde-ae96-4c2c3a761122 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:58.725253 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-8993237c-b9b1-4cde-ae96-4c2c3a761122 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:58.725759 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-8993237c-b9b1-4cde-ae96-4c2c3a761122 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:58.937625 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-8993237c-b9b1-4cde-ae96-4c2c3a761122 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31758734d70b471081c8262b0492bc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc1b3def14c1f8ea4f6635967b351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:56:58.952633 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-8993237c-b9b1-4cde-ae96-4c2c3a761122 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] 10.222.0.48 "GET /compute/v2.1/servers/cd58846b-cc10-48d8-9a05-8c893d7cd80d" status: 200 len: 1314 microversion: 2.1 time: 0.248625 Apr 08 02:56:58.954047 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 500/1002] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:56:58 2022] GET /compute/v2.1/servers/cd58846b-cc10-48d8-9a05-8c893d7cd80d => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:56:58.973782 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-1a01e392-f752-40c7-8e50-821bfe49c4b3 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:58.975049 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-1a01e392-f752-40c7-8e50-821bfe49c4b3 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] [instance: db095363-7817-4713-9eb0-3bcda511112e] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:56:58.984709 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-1a01e392-f752-40c7-8e50-821bfe49c4b3 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:58.985380 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-1a01e392-f752-40c7-8e50-821bfe49c4b3 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:58.987245 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-1a01e392-f752-40c7-8e50-821bfe49c4b3 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:58.991125 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-1a01e392-f752-40c7-8e50-821bfe49c4b3 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:59.215506 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-1a01e392-f752-40c7-8e50-821bfe49c4b3 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d94e2a615ab42aaa79b7c8470f7808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89cf122bfb64dbca81527f5cac790a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:56:59.225210 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-1a01e392-f752-40c7-8e50-821bfe49c4b3 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] 10.222.0.48 "GET /compute/v2.1/servers/db095363-7817-4713-9eb0-3bcda511112e" status: 200 len: 1266 microversion: 2.1 time: 0.261293 Apr 08 02:56:59.225763 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 503/1003] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:56:58 2022] GET /compute/v2.1/servers/db095363-7817-4713-9eb0-3bcda511112e => generated 1266 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:56:59.977194 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-e7aa1a9b-9e7d-44bf-a8b4-bf72723d43b2 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:56:59.977874 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-e7aa1a9b-9e7d-44bf-a8b4-bf72723d43b2 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] [instance: cd58846b-cc10-48d8-9a05-8c893d7cd80d] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:56:59.985796 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-e7aa1a9b-9e7d-44bf-a8b4-bf72723d43b2 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:59.986244 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-e7aa1a9b-9e7d-44bf-a8b4-bf72723d43b2 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:56:59.987138 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-e7aa1a9b-9e7d-44bf-a8b4-bf72723d43b2 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:56:59.988420 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-e7aa1a9b-9e7d-44bf-a8b4-bf72723d43b2 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:00.195345 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-e7aa1a9b-9e7d-44bf-a8b4-bf72723d43b2 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31758734d70b471081c8262b0492bc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc1b3def14c1f8ea4f6635967b351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:57:00.203553 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-e7aa1a9b-9e7d-44bf-a8b4-bf72723d43b2 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] 10.222.0.48 "GET /compute/v2.1/servers/cd58846b-cc10-48d8-9a05-8c893d7cd80d" status: 200 len: 1314 microversion: 2.1 time: 0.236788 Apr 08 02:57:00.204090 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 501/1004] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:56:59 2022] GET /compute/v2.1/servers/cd58846b-cc10-48d8-9a05-8c893d7cd80d => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:57:00.246688 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-53fb17f4-a5db-4485-bc2a-d82b89c80283 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:00.247297 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-53fb17f4-a5db-4485-bc2a-d82b89c80283 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] [instance: db095363-7817-4713-9eb0-3bcda511112e] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:57:00.255227 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-53fb17f4-a5db-4485-bc2a-d82b89c80283 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:00.255678 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-53fb17f4-a5db-4485-bc2a-d82b89c80283 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:00.256444 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-53fb17f4-a5db-4485-bc2a-d82b89c80283 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:00.256871 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-53fb17f4-a5db-4485-bc2a-d82b89c80283 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:00.462189 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-53fb17f4-a5db-4485-bc2a-d82b89c80283 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d94e2a615ab42aaa79b7c8470f7808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89cf122bfb64dbca81527f5cac790a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:57:00.470328 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-53fb17f4-a5db-4485-bc2a-d82b89c80283 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] 10.222.0.48 "GET /compute/v2.1/servers/db095363-7817-4713-9eb0-3bcda511112e" status: 200 len: 1266 microversion: 2.1 time: 0.232976 Apr 08 02:57:00.470882 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 504/1005] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:00 2022] GET /compute/v2.1/servers/db095363-7817-4713-9eb0-3bcda511112e => generated 1266 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:57:01.225319 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-7acec0aa-b76c-483a-904e-ef9041b68ebd tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:01.225999 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-7acec0aa-b76c-483a-904e-ef9041b68ebd tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] [instance: cd58846b-cc10-48d8-9a05-8c893d7cd80d] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:57:01.233149 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-7acec0aa-b76c-483a-904e-ef9041b68ebd tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:01.233662 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-7acec0aa-b76c-483a-904e-ef9041b68ebd tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:01.234551 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-7acec0aa-b76c-483a-904e-ef9041b68ebd tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:01.235156 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-7acec0aa-b76c-483a-904e-ef9041b68ebd tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:01.492844 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-90cfee8b-4640-4c05-9ca9-58c988a53dd5 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:01.493442 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-90cfee8b-4640-4c05-9ca9-58c988a53dd5 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] [instance: db095363-7817-4713-9eb0-3bcda511112e] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:57:01.500572 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-90cfee8b-4640-4c05-9ca9-58c988a53dd5 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:01.501011 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-90cfee8b-4640-4c05-9ca9-58c988a53dd5 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:01.501779 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-90cfee8b-4640-4c05-9ca9-58c988a53dd5 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:01.502324 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-90cfee8b-4640-4c05-9ca9-58c988a53dd5 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:01.540644 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-7acec0aa-b76c-483a-904e-ef9041b68ebd tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31758734d70b471081c8262b0492bc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc1b3def14c1f8ea4f6635967b351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:57:01.548905 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-7acec0aa-b76c-483a-904e-ef9041b68ebd tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] 10.222.0.48 "GET /compute/v2.1/servers/cd58846b-cc10-48d8-9a05-8c893d7cd80d" status: 200 len: 1314 microversion: 2.1 time: 0.332547 Apr 08 02:57:01.549434 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 502/1006] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:01 2022] GET /compute/v2.1/servers/cd58846b-cc10-48d8-9a05-8c893d7cd80d => generated 1314 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:57:01.719587 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-90cfee8b-4640-4c05-9ca9-58c988a53dd5 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d94e2a615ab42aaa79b7c8470f7808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89cf122bfb64dbca81527f5cac790a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:57:01.727784 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-90cfee8b-4640-4c05-9ca9-58c988a53dd5 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] 10.222.0.48 "GET /compute/v2.1/servers/db095363-7817-4713-9eb0-3bcda511112e" status: 200 len: 1266 microversion: 2.1 time: 0.244768 Apr 08 02:57:01.728322 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 505/1007] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:01 2022] GET /compute/v2.1/servers/db095363-7817-4713-9eb0-3bcda511112e => generated 1266 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:57:02.572467 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-286a6267-41f5-4fbc-b2bf-59617b015f4f tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:02.573078 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-286a6267-41f5-4fbc-b2bf-59617b015f4f tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] [instance: cd58846b-cc10-48d8-9a05-8c893d7cd80d] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:57:02.580302 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-286a6267-41f5-4fbc-b2bf-59617b015f4f tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:02.580740 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-286a6267-41f5-4fbc-b2bf-59617b015f4f tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:02.581814 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-286a6267-41f5-4fbc-b2bf-59617b015f4f tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:02.582245 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-286a6267-41f5-4fbc-b2bf-59617b015f4f tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:02.749636 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-cf42490a-bc1a-433d-b05a-ec3696beab8c tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:02.750225 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-cf42490a-bc1a-433d-b05a-ec3696beab8c tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] [instance: db095363-7817-4713-9eb0-3bcda511112e] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:57:02.758524 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-cf42490a-bc1a-433d-b05a-ec3696beab8c tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:02.759397 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-cf42490a-bc1a-433d-b05a-ec3696beab8c tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:02.760545 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-cf42490a-bc1a-433d-b05a-ec3696beab8c tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:02.761241 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-cf42490a-bc1a-433d-b05a-ec3696beab8c tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:02.811240 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-286a6267-41f5-4fbc-b2bf-59617b015f4f tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31758734d70b471081c8262b0492bc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc1b3def14c1f8ea4f6635967b351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:57:02.821051 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-286a6267-41f5-4fbc-b2bf-59617b015f4f tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] 10.222.0.48 "GET /compute/v2.1/servers/cd58846b-cc10-48d8-9a05-8c893d7cd80d" status: 200 len: 1314 microversion: 2.1 time: 0.258568 Apr 08 02:57:02.830331 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 503/1008] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:02 2022] GET /compute/v2.1/servers/cd58846b-cc10-48d8-9a05-8c893d7cd80d => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:57:03.071764 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [req-38555650-2467-4aef-9678-602da24479d1 req-22f83179-2be1-4084-a526-bf772b8e91ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd58846b-cc10-48d8-9a05-8c893d7cd80d", "name": "network-vif-plugged", "status": "completed", "tag": "c7346b5f-ce63-42a6-a172-73865f9b3a74"}]} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:57:03.078313 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:57:03.078313 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: warnings.warn(msg) Apr 08 02:57:03.082126 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-cf42490a-bc1a-433d-b05a-ec3696beab8c tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d94e2a615ab42aaa79b7c8470f7808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89cf122bfb64dbca81527f5cac790a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:57:03.089030 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-38555650-2467-4aef-9678-602da24479d1 req-22f83179-2be1-4084-a526-bf772b8e91ea service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:03.089726 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-38555650-2467-4aef-9678-602da24479d1 req-22f83179-2be1-4084-a526-bf772b8e91ea service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:03.090344 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-cf42490a-bc1a-433d-b05a-ec3696beab8c tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] 10.222.0.48 "GET /compute/v2.1/servers/db095363-7817-4713-9eb0-3bcda511112e" status: 200 len: 1266 microversion: 2.1 time: 0.349519 Apr 08 02:57:03.090982 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 506/1009] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:02 2022] GET /compute/v2.1/servers/db095363-7817-4713-9eb0-3bcda511112e => generated 1266 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:57:03.106291 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.compute.server_external_events [req-38555650-2467-4aef-9678-602da24479d1 req-22f83179-2be1-4084-a526-bf772b8e91ea service nova] Creating event network-vif-plugged:c7346b5f-ce63-42a6-a172-73865f9b3a74 for instance cd58846b-cc10-48d8-9a05-8c893d7cd80d on hv-cinder-83705 Apr 08 02:57:03.110961 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [req-38555650-2467-4aef-9678-602da24479d1 req-22f83179-2be1-4084-a526-bf772b8e91ea service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.278459 Apr 08 02:57:03.111537 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 504/1010] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:57:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:57:03.843085 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-dd8daeb7-3b84-4237-99cf-7ac9de62a124 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:03.843683 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-dd8daeb7-3b84-4237-99cf-7ac9de62a124 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] [instance: cd58846b-cc10-48d8-9a05-8c893d7cd80d] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:57:03.851384 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-dd8daeb7-3b84-4237-99cf-7ac9de62a124 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:03.851830 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-dd8daeb7-3b84-4237-99cf-7ac9de62a124 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:03.852597 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-dd8daeb7-3b84-4237-99cf-7ac9de62a124 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:03.853066 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-dd8daeb7-3b84-4237-99cf-7ac9de62a124 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:04.058842 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-dd8daeb7-3b84-4237-99cf-7ac9de62a124 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31758734d70b471081c8262b0492bc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc1b3def14c1f8ea4f6635967b351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:57:04.066753 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-dd8daeb7-3b84-4237-99cf-7ac9de62a124 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] 10.222.0.48 "GET /compute/v2.1/servers/cd58846b-cc10-48d8-9a05-8c893d7cd80d" status: 200 len: 1314 microversion: 2.1 time: 0.232672 Apr 08 02:57:04.067931 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 507/1011] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:03 2022] GET /compute/v2.1/servers/cd58846b-cc10-48d8-9a05-8c893d7cd80d => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:57:04.113750 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-3f94c596-1864-4924-b92b-5322fcacabb9 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:04.115088 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-3f94c596-1864-4924-b92b-5322fcacabb9 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] [instance: db095363-7817-4713-9eb0-3bcda511112e] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:57:04.123163 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-3f94c596-1864-4924-b92b-5322fcacabb9 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:04.123836 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-3f94c596-1864-4924-b92b-5322fcacabb9 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:04.124960 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-3f94c596-1864-4924-b92b-5322fcacabb9 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:04.125396 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-3f94c596-1864-4924-b92b-5322fcacabb9 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:04.336189 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-3f94c596-1864-4924-b92b-5322fcacabb9 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d94e2a615ab42aaa79b7c8470f7808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89cf122bfb64dbca81527f5cac790a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:57:04.344552 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-3f94c596-1864-4924-b92b-5322fcacabb9 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] 10.222.0.48 "GET /compute/v2.1/servers/db095363-7817-4713-9eb0-3bcda511112e" status: 200 len: 1266 microversion: 2.1 time: 0.240612 Apr 08 02:57:04.345199 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 505/1012] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:04 2022] GET /compute/v2.1/servers/db095363-7817-4713-9eb0-3bcda511112e => generated 1266 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:57:05.090231 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-278cf47c-83eb-46fc-9570-44c4b9d0e4db tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:05.097363 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-278cf47c-83eb-46fc-9570-44c4b9d0e4db tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] [instance: cd58846b-cc10-48d8-9a05-8c893d7cd80d] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:57:05.105078 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-278cf47c-83eb-46fc-9570-44c4b9d0e4db tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:05.105638 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-278cf47c-83eb-46fc-9570-44c4b9d0e4db tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:05.106574 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-278cf47c-83eb-46fc-9570-44c4b9d0e4db tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:05.107139 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-278cf47c-83eb-46fc-9570-44c4b9d0e4db tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:05.329293 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-278cf47c-83eb-46fc-9570-44c4b9d0e4db tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31758734d70b471081c8262b0492bc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc1b3def14c1f8ea4f6635967b351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:57:05.337915 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-278cf47c-83eb-46fc-9570-44c4b9d0e4db tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] 10.222.0.48 "GET /compute/v2.1/servers/cd58846b-cc10-48d8-9a05-8c893d7cd80d" status: 200 len: 1498 microversion: 2.1 time: 0.257277 Apr 08 02:57:05.338765 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 508/1013] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:05 2022] GET /compute/v2.1/servers/cd58846b-cc10-48d8-9a05-8c893d7cd80d => generated 1498 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:57:05.366905 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-e1b7d303-074c-4a81-990a-4da07736da25 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:05.368081 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-e1b7d303-074c-4a81-990a-4da07736da25 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] [instance: db095363-7817-4713-9eb0-3bcda511112e] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:57:05.377170 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-e1b7d303-074c-4a81-990a-4da07736da25 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:05.377638 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-e1b7d303-074c-4a81-990a-4da07736da25 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:05.378602 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-e1b7d303-074c-4a81-990a-4da07736da25 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:05.379223 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-e1b7d303-074c-4a81-990a-4da07736da25 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:05.593961 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-e1b7d303-074c-4a81-990a-4da07736da25 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d94e2a615ab42aaa79b7c8470f7808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89cf122bfb64dbca81527f5cac790a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:57:05.604005 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-e1b7d303-074c-4a81-990a-4da07736da25 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] 10.222.0.48 "GET /compute/v2.1/servers/db095363-7817-4713-9eb0-3bcda511112e" status: 200 len: 1266 microversion: 2.1 time: 0.246385 Apr 08 02:57:05.604817 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 506/1014] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:05 2022] GET /compute/v2.1/servers/db095363-7817-4713-9eb0-3bcda511112e => generated 1266 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:57:06.026438 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-7b56b6b9-4d4a-4873-8690-8da00839b7d1 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:06.026960 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-7b56b6b9-4d4a-4873-8690-8da00839b7d1 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] [instance: cd58846b-cc10-48d8-9a05-8c893d7cd80d] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:57:06.034098 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-7b56b6b9-4d4a-4873-8690-8da00839b7d1 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:06.034540 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-7b56b6b9-4d4a-4873-8690-8da00839b7d1 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:06.035334 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-7b56b6b9-4d4a-4873-8690-8da00839b7d1 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:06.035805 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-7b56b6b9-4d4a-4873-8690-8da00839b7d1 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:06.102962 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-7b56b6b9-4d4a-4873-8690-8da00839b7d1 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] [instance: cd58846b-cc10-48d8-9a05-8c893d7cd80d] Going to try to terminate instance {{(pid=96920) delete /opt/stack/nova/nova/compute/api.py:2559}} Apr 08 02:57:06.211804 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-7b56b6b9-4d4a-4873-8690-8da00839b7d1 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] 10.222.0.48 "DELETE /compute/v2.1/servers/cd58846b-cc10-48d8-9a05-8c893d7cd80d" status: 204 len: 0 microversion: 2.1 time: 0.193774 Apr 08 02:57:06.212433 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 509/1015] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Apr 8 02:57:06 2022] DELETE /compute/v2.1/servers/cd58846b-cc10-48d8-9a05-8c893d7cd80d => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 08 02:57:06.225986 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-d0048079-9575-4962-8bc4-e5d2edf17d93 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:06.226578 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-d0048079-9575-4962-8bc4-e5d2edf17d93 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] [instance: cd58846b-cc10-48d8-9a05-8c893d7cd80d] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:57:06.234385 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-d0048079-9575-4962-8bc4-e5d2edf17d93 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:06.234861 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-d0048079-9575-4962-8bc4-e5d2edf17d93 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:06.235635 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-d0048079-9575-4962-8bc4-e5d2edf17d93 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:06.236066 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-d0048079-9575-4962-8bc4-e5d2edf17d93 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:06.438479 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-d0048079-9575-4962-8bc4-e5d2edf17d93 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31758734d70b471081c8262b0492bc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc1b3def14c1f8ea4f6635967b351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:57:06.446626 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-d0048079-9575-4962-8bc4-e5d2edf17d93 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] 10.222.0.48 "GET /compute/v2.1/servers/cd58846b-cc10-48d8-9a05-8c893d7cd80d" status: 200 len: 1504 microversion: 2.1 time: 0.229838 Apr 08 02:57:06.447190 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 507/1016] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:06 2022] GET /compute/v2.1/servers/cd58846b-cc10-48d8-9a05-8c893d7cd80d => generated 1504 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:57:06.626554 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-8d444ba9-4c85-4a16-aa12-4bd3021ac181 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:06.627261 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-8d444ba9-4c85-4a16-aa12-4bd3021ac181 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] [instance: db095363-7817-4713-9eb0-3bcda511112e] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:57:06.635226 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-8d444ba9-4c85-4a16-aa12-4bd3021ac181 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:06.635662 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-8d444ba9-4c85-4a16-aa12-4bd3021ac181 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:06.636423 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-8d444ba9-4c85-4a16-aa12-4bd3021ac181 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:06.636835 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-8d444ba9-4c85-4a16-aa12-4bd3021ac181 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:06.801100 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [req-b177c26c-1c73-47e8-a565-2fea958d738d req-5467052d-9b5c-4fc1-b90f-fbb4c352ac70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db095363-7817-4713-9eb0-3bcda511112e", "name": "network-vif-plugged", "status": "completed", "tag": "1ff823af-42f9-4594-93e9-62f6e5e8c8b1"}]} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:57:06.808160 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:57:06.808160 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: warnings.warn(msg) Apr 08 02:57:06.818846 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-b177c26c-1c73-47e8-a565-2fea958d738d req-5467052d-9b5c-4fc1-b90f-fbb4c352ac70 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:06.819297 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-b177c26c-1c73-47e8-a565-2fea958d738d req-5467052d-9b5c-4fc1-b90f-fbb4c352ac70 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:06.844264 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.compute.server_external_events [req-b177c26c-1c73-47e8-a565-2fea958d738d req-5467052d-9b5c-4fc1-b90f-fbb4c352ac70 service nova] Creating event network-vif-plugged:1ff823af-42f9-4594-93e9-62f6e5e8c8b1 for instance db095363-7817-4713-9eb0-3bcda511112e on hv-cinder-83705 Apr 08 02:57:06.851174 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [req-b177c26c-1c73-47e8-a565-2fea958d738d req-5467052d-9b5c-4fc1-b90f-fbb4c352ac70 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059173 Apr 08 02:57:06.852299 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 508/1017] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:57:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 02:57:06.861534 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-8d444ba9-4c85-4a16-aa12-4bd3021ac181 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d94e2a615ab42aaa79b7c8470f7808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89cf122bfb64dbca81527f5cac790a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:57:06.870634 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-8d444ba9-4c85-4a16-aa12-4bd3021ac181 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] 10.222.0.48 "GET /compute/v2.1/servers/db095363-7817-4713-9eb0-3bcda511112e" status: 200 len: 1266 microversion: 2.1 time: 0.253356 Apr 08 02:57:06.871323 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 510/1018] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:06 2022] GET /compute/v2.1/servers/db095363-7817-4713-9eb0-3bcda511112e => generated 1266 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:57:06.885561 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-88682211-62da-4a3d-8ed7-861abb19cdd5 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1226696351", "imageRef": "7f8ca061-f382-4052-8d05-69f37e107684", "flavorRef": "452"}} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:57:06.952339 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.network.neutron [None req-88682211-62da-4a3d-8ed7-861abb19cdd5 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] validate_networks() for None {{(pid=96919) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} Apr 08 02:57:07.214404 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.virt.hardware [None req-88682211-62da-4a3d-8ed7-861abb19cdd5 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Flavor limits 0:0:0 {{(pid=96919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} Apr 08 02:57:07.214859 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.virt.hardware [None req-88682211-62da-4a3d-8ed7-861abb19cdd5 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Image limits 0:0:0 {{(pid=96919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} Apr 08 02:57:07.215327 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.virt.hardware [None req-88682211-62da-4a3d-8ed7-861abb19cdd5 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Flavor pref 0:0:0 {{(pid=96919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} Apr 08 02:57:07.215729 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.virt.hardware [None req-88682211-62da-4a3d-8ed7-861abb19cdd5 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Image pref 0:0:0 {{(pid=96919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} Apr 08 02:57:07.216135 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.virt.hardware [None req-88682211-62da-4a3d-8ed7-861abb19cdd5 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=96919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} Apr 08 02:57:07.224923 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-88682211-62da-4a3d-8ed7-861abb19cdd5 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:07.225357 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-88682211-62da-4a3d-8ed7-861abb19cdd5 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:07.226139 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-88682211-62da-4a3d-8ed7-861abb19cdd5 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:07.226564 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-88682211-62da-4a3d-8ed7-861abb19cdd5 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:07.243891 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.quota [None req-88682211-62da-4a3d-8ed7-861abb19cdd5 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Getting quotas for project 217aba6f4bb34d35bfc01c21fb7fc95a. Resources: {'instances', 'cores', 'ram'} {{(pid=96919) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:57:07.247785 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.quota [None req-88682211-62da-4a3d-8ed7-861abb19cdd5 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Getting quotas for user 3b24e5894c0e435a897a7d397109b4e3 and project 217aba6f4bb34d35bfc01c21fb7fc95a. Resources: {'instances', 'cores', 'ram'} {{(pid=96919) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:57:07.258595 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-88682211-62da-4a3d-8ed7-861abb19cdd5 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Going to run 1 instances... {{(pid=96919) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} Apr 08 02:57:07.261020 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-88682211-62da-4a3d-8ed7-861abb19cdd5 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] [instance: f16387f5-f4ba-4ae2-9cfb-a35c14b5b870] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7f8ca061-f382-4052-8d05-69f37e107684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=96919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} Apr 08 02:57:07.307447 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-88682211-62da-4a3d-8ed7-861abb19cdd5 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.433226 Apr 08 02:57:07.308079 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 509/1019] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Apr 8 02:57:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 435 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 08 02:57:07.323075 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-5aa9c556-8fa0-466d-af0c-720a26f98c7f tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:07.323676 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-5aa9c556-8fa0-466d-af0c-720a26f98c7f tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] [instance: f16387f5-f4ba-4ae2-9cfb-a35c14b5b870] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:57:07.400201 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-5aa9c556-8fa0-466d-af0c-720a26f98c7f tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b24e5894c0e435a897a7d397109b4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217aba6f4bb34d35bfc01c21fb7fc95a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:57:07.408111 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-5aa9c556-8fa0-466d-af0c-720a26f98c7f tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] 10.222.0.48 "GET /compute/v2.1/servers/f16387f5-f4ba-4ae2-9cfb-a35c14b5b870" status: 200 len: 1215 microversion: 2.1 time: 0.094116 Apr 08 02:57:07.408654 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 511/1020] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:07 2022] GET /compute/v2.1/servers/f16387f5-f4ba-4ae2-9cfb-a35c14b5b870 => generated 1215 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:57:07.470769 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-d09bc4d8-5600-4728-aef0-26b37c577fa5 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:07.471369 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-d09bc4d8-5600-4728-aef0-26b37c577fa5 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] [instance: cd58846b-cc10-48d8-9a05-8c893d7cd80d] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:57:07.480846 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-d09bc4d8-5600-4728-aef0-26b37c577fa5 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:07.481287 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-d09bc4d8-5600-4728-aef0-26b37c577fa5 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:07.482055 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-d09bc4d8-5600-4728-aef0-26b37c577fa5 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:07.482782 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-d09bc4d8-5600-4728-aef0-26b37c577fa5 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:07.709802 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-d09bc4d8-5600-4728-aef0-26b37c577fa5 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31758734d70b471081c8262b0492bc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc1b3def14c1f8ea4f6635967b351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:57:07.718082 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-d09bc4d8-5600-4728-aef0-26b37c577fa5 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] 10.222.0.48 "GET /compute/v2.1/servers/cd58846b-cc10-48d8-9a05-8c893d7cd80d" status: 200 len: 1504 microversion: 2.1 time: 0.257442 Apr 08 02:57:07.718617 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 510/1021] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:07 2022] GET /compute/v2.1/servers/cd58846b-cc10-48d8-9a05-8c893d7cd80d => generated 1504 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:57:07.895225 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-19e542e4-9a82-4ab8-b9b8-5d535dcd8b5c tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:07.896145 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-19e542e4-9a82-4ab8-b9b8-5d535dcd8b5c tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] [instance: db095363-7817-4713-9eb0-3bcda511112e] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:57:07.903674 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-19e542e4-9a82-4ab8-b9b8-5d535dcd8b5c tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:07.904153 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-19e542e4-9a82-4ab8-b9b8-5d535dcd8b5c tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:07.905020 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-19e542e4-9a82-4ab8-b9b8-5d535dcd8b5c tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:07.905542 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-19e542e4-9a82-4ab8-b9b8-5d535dcd8b5c tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:08.131329 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-19e542e4-9a82-4ab8-b9b8-5d535dcd8b5c tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d94e2a615ab42aaa79b7c8470f7808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89cf122bfb64dbca81527f5cac790a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:57:08.139564 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-19e542e4-9a82-4ab8-b9b8-5d535dcd8b5c tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] 10.222.0.48 "GET /compute/v2.1/servers/db095363-7817-4713-9eb0-3bcda511112e" status: 200 len: 1266 microversion: 2.1 time: 0.254910 Apr 08 02:57:08.140113 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 512/1022] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:07 2022] GET /compute/v2.1/servers/db095363-7817-4713-9eb0-3bcda511112e => generated 1266 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:57:08.431506 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-2eec9252-b064-4d4f-98d6-ccf02679bbb3 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:08.432016 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-2eec9252-b064-4d4f-98d6-ccf02679bbb3 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] [instance: f16387f5-f4ba-4ae2-9cfb-a35c14b5b870] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:57:08.439583 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-2eec9252-b064-4d4f-98d6-ccf02679bbb3 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:08.440020 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-2eec9252-b064-4d4f-98d6-ccf02679bbb3 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:08.440972 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-2eec9252-b064-4d4f-98d6-ccf02679bbb3 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:08.441567 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-2eec9252-b064-4d4f-98d6-ccf02679bbb3 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:08.587025 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-2eec9252-b064-4d4f-98d6-ccf02679bbb3 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b24e5894c0e435a897a7d397109b4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217aba6f4bb34d35bfc01c21fb7fc95a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:57:08.595294 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-2eec9252-b064-4d4f-98d6-ccf02679bbb3 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] 10.222.0.48 "GET /compute/v2.1/servers/f16387f5-f4ba-4ae2-9cfb-a35c14b5b870" status: 200 len: 1285 microversion: 2.1 time: 0.173418 Apr 08 02:57:08.604824 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 511/1023] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:08 2022] GET /compute/v2.1/servers/f16387f5-f4ba-4ae2-9cfb-a35c14b5b870 => generated 1285 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:57:08.739961 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-1eeda705-868a-46eb-9b8a-3e01c5300e2b tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:08.740544 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-1eeda705-868a-46eb-9b8a-3e01c5300e2b tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] [instance: cd58846b-cc10-48d8-9a05-8c893d7cd80d] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:57:08.748825 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-1eeda705-868a-46eb-9b8a-3e01c5300e2b tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:08.749263 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-1eeda705-868a-46eb-9b8a-3e01c5300e2b tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:08.750036 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-1eeda705-868a-46eb-9b8a-3e01c5300e2b tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:08.750461 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-1eeda705-868a-46eb-9b8a-3e01c5300e2b tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:08.857868 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [req-4b032254-49fb-4f07-b082-47e880e103dc req-246750cf-6501-4ed2-89ff-5037fca480db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd58846b-cc10-48d8-9a05-8c893d7cd80d", "name": "network-vif-deleted", "tag": "c7346b5f-ce63-42a6-a172-73865f9b3a74"}]} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:57:08.865006 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:57:08.865006 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: warnings.warn(msg) Apr 08 02:57:08.873333 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-4b032254-49fb-4f07-b082-47e880e103dc req-246750cf-6501-4ed2-89ff-5037fca480db service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:08.873779 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-4b032254-49fb-4f07-b082-47e880e103dc req-246750cf-6501-4ed2-89ff-5037fca480db service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:08.876565 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-1eeda705-868a-46eb-9b8a-3e01c5300e2b tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31758734d70b471081c8262b0492bc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc1b3def14c1f8ea4f6635967b351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:57:08.886515 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-1eeda705-868a-46eb-9b8a-3e01c5300e2b tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] 10.222.0.48 "GET /compute/v2.1/servers/cd58846b-cc10-48d8-9a05-8c893d7cd80d" status: 200 len: 1462 microversion: 2.1 time: 0.155897 Apr 08 02:57:08.887994 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 513/1024] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:08 2022] GET /compute/v2.1/servers/cd58846b-cc10-48d8-9a05-8c893d7cd80d => generated 1462 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:57:08.891310 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.compute.server_external_events [req-4b032254-49fb-4f07-b082-47e880e103dc req-246750cf-6501-4ed2-89ff-5037fca480db service nova] Creating event network-vif-deleted:c7346b5f-ce63-42a6-a172-73865f9b3a74 for instance cd58846b-cc10-48d8-9a05-8c893d7cd80d on hv-cinder-83705 Apr 08 02:57:08.897840 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [req-4b032254-49fb-4f07-b082-47e880e103dc req-246750cf-6501-4ed2-89ff-5037fca480db service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050137 Apr 08 02:57:08.898799 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 512/1025] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:57:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 02:57:09.161779 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-76c6d586-077b-448e-b6da-33f34886a2d6 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:09.162386 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-76c6d586-077b-448e-b6da-33f34886a2d6 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] [instance: db095363-7817-4713-9eb0-3bcda511112e] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:57:09.169496 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-76c6d586-077b-448e-b6da-33f34886a2d6 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:09.169938 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-76c6d586-077b-448e-b6da-33f34886a2d6 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:09.170735 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-76c6d586-077b-448e-b6da-33f34886a2d6 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:09.171165 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-76c6d586-077b-448e-b6da-33f34886a2d6 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:09.387738 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-76c6d586-077b-448e-b6da-33f34886a2d6 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d94e2a615ab42aaa79b7c8470f7808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89cf122bfb64dbca81527f5cac790a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:57:09.396395 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-76c6d586-077b-448e-b6da-33f34886a2d6 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] 10.222.0.48 "GET /compute/v2.1/servers/db095363-7817-4713-9eb0-3bcda511112e" status: 200 len: 1453 microversion: 2.1 time: 0.243452 Apr 08 02:57:09.407143 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 514/1026] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:09 2022] GET /compute/v2.1/servers/db095363-7817-4713-9eb0-3bcda511112e => generated 1453 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:57:09.419829 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-a0255f55-d49a-41cf-9ad9-76de04731508 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:09.420690 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-a0255f55-d49a-41cf-9ad9-76de04731508 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] [instance: db095363-7817-4713-9eb0-3bcda511112e] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:57:09.429084 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-a0255f55-d49a-41cf-9ad9-76de04731508 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:09.429621 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-a0255f55-d49a-41cf-9ad9-76de04731508 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:09.430477 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-a0255f55-d49a-41cf-9ad9-76de04731508 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:09.431013 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-a0255f55-d49a-41cf-9ad9-76de04731508 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:09.626636 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-5df0eb00-1e8e-45dd-8076-bcba2527d12b tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:09.627369 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-5df0eb00-1e8e-45dd-8076-bcba2527d12b tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] [instance: f16387f5-f4ba-4ae2-9cfb-a35c14b5b870] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:57:09.635236 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-5df0eb00-1e8e-45dd-8076-bcba2527d12b tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:09.635751 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-5df0eb00-1e8e-45dd-8076-bcba2527d12b tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:09.636588 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-5df0eb00-1e8e-45dd-8076-bcba2527d12b tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:09.637078 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-5df0eb00-1e8e-45dd-8076-bcba2527d12b tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:09.647211 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-a0255f55-d49a-41cf-9ad9-76de04731508 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d94e2a615ab42aaa79b7c8470f7808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89cf122bfb64dbca81527f5cac790a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:57:09.657611 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-a0255f55-d49a-41cf-9ad9-76de04731508 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] 10.222.0.48 "GET /compute/v2.1/servers/db095363-7817-4713-9eb0-3bcda511112e" status: 200 len: 1453 microversion: 2.1 time: 0.248439 Apr 08 02:57:09.658800 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 513/1027] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:09 2022] GET /compute/v2.1/servers/db095363-7817-4713-9eb0-3bcda511112e => generated 1453 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:57:09.896862 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-5df0eb00-1e8e-45dd-8076-bcba2527d12b tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b24e5894c0e435a897a7d397109b4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217aba6f4bb34d35bfc01c21fb7fc95a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:57:09.907143 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-5df0eb00-1e8e-45dd-8076-bcba2527d12b tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] 10.222.0.48 "GET /compute/v2.1/servers/f16387f5-f4ba-4ae2-9cfb-a35c14b5b870" status: 200 len: 1315 microversion: 2.1 time: 0.289384 Apr 08 02:57:09.908238 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 515/1028] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:09 2022] GET /compute/v2.1/servers/f16387f5-f4ba-4ae2-9cfb-a35c14b5b870 => generated 1315 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:57:09.909708 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-892a94bc-e75a-4ece-b006-f2690ed18ca3 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:09.910543 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-892a94bc-e75a-4ece-b006-f2690ed18ca3 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] [instance: cd58846b-cc10-48d8-9a05-8c893d7cd80d] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:57:09.919915 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-892a94bc-e75a-4ece-b006-f2690ed18ca3 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:09.920567 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-892a94bc-e75a-4ece-b006-f2690ed18ca3 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:09.921354 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-892a94bc-e75a-4ece-b006-f2690ed18ca3 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:09.921785 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-892a94bc-e75a-4ece-b006-f2690ed18ca3 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:09.999387 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.wsgi [None req-892a94bc-e75a-4ece-b006-f2690ed18ca3 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] HTTP exception thrown: Instance cd58846b-cc10-48d8-9a05-8c893d7cd80d could not be found. Apr 08 02:57:10.000086 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-892a94bc-e75a-4ece-b006-f2690ed18ca3 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Returning 404 to user: Instance cd58846b-cc10-48d8-9a05-8c893d7cd80d could not be found. {{(pid=96919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Apr 08 02:57:10.003615 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-892a94bc-e75a-4ece-b006-f2690ed18ca3 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] 10.222.0.48 "GET /compute/v2.1/servers/cd58846b-cc10-48d8-9a05-8c893d7cd80d" status: 404 len: 111 microversion: 2.1 time: 0.102558 Apr 08 02:57:10.005192 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 514/1029] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:09 2022] GET /compute/v2.1/servers/cd58846b-cc10-48d8-9a05-8c893d7cd80d => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 08 02:57:10.137305 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-d30d1987-f037-4d69-b851-36ccc0afbd92 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1961066292", "imageRef": "7f8ca061-f382-4052-8d05-69f37e107684", "flavorRef": "452", "networks": [{"uuid": "5c550fb9-4d2f-42b9-9101-9100317842af"}]}} {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:57:10.208557 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.network.neutron [None req-d30d1987-f037-4d69-b851-36ccc0afbd92 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] validate_networks() for [('5c550fb9-4d2f-42b9-9101-9100317842af', None, None, None)] {{(pid=96920) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} Apr 08 02:57:10.922928 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [req-5e28f5e3-ae90-4a1d-89fc-9e1284870750 req-7ced9cdc-be8c-45c1-acc9-12de93574343 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f16387f5-f4ba-4ae2-9cfb-a35c14b5b870", "tag": "a6ea4052-8f54-4729-83de-50ef43ebc525"}]} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:57:10.930921 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:57:10.930921 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: warnings.warn(msg) Apr 08 02:57:10.940041 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-5e28f5e3-ae90-4a1d-89fc-9e1284870750 req-7ced9cdc-be8c-45c1-acc9-12de93574343 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:10.940713 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-5e28f5e3-ae90-4a1d-89fc-9e1284870750 req-7ced9cdc-be8c-45c1-acc9-12de93574343 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:10.964629 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.compute.server_external_events [req-5e28f5e3-ae90-4a1d-89fc-9e1284870750 req-7ced9cdc-be8c-45c1-acc9-12de93574343 service nova] Creating event network-changed:a6ea4052-8f54-4729-83de-50ef43ebc525 for instance f16387f5-f4ba-4ae2-9cfb-a35c14b5b870 on hv-cinder-83705 Apr 08 02:57:10.969861 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [req-5e28f5e3-ae90-4a1d-89fc-9e1284870750 req-7ced9cdc-be8c-45c1-acc9-12de93574343 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055939 Apr 08 02:57:10.970896 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 515/1030] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:57:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:57:10.983277 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-a0f65a20-342d-4e55-a56c-55a277ad02a1 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:10.984396 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-a0f65a20-342d-4e55-a56c-55a277ad02a1 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] [instance: f16387f5-f4ba-4ae2-9cfb-a35c14b5b870] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:57:10.993020 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-a0f65a20-342d-4e55-a56c-55a277ad02a1 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:10.993786 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-a0f65a20-342d-4e55-a56c-55a277ad02a1 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:10.995057 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-a0f65a20-342d-4e55-a56c-55a277ad02a1 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:10.995537 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-a0f65a20-342d-4e55-a56c-55a277ad02a1 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:11.090560 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.virt.hardware [None req-d30d1987-f037-4d69-b851-36ccc0afbd92 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Flavor limits 0:0:0 {{(pid=96920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} Apr 08 02:57:11.091112 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.virt.hardware [None req-d30d1987-f037-4d69-b851-36ccc0afbd92 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Image limits 0:0:0 {{(pid=96920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} Apr 08 02:57:11.091483 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.virt.hardware [None req-d30d1987-f037-4d69-b851-36ccc0afbd92 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Flavor pref 0:0:0 {{(pid=96920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} Apr 08 02:57:11.091892 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.virt.hardware [None req-d30d1987-f037-4d69-b851-36ccc0afbd92 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Image pref 0:0:0 {{(pid=96920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} Apr 08 02:57:11.092301 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.virt.hardware [None req-d30d1987-f037-4d69-b851-36ccc0afbd92 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=96920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} Apr 08 02:57:11.102092 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-d30d1987-f037-4d69-b851-36ccc0afbd92 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:11.102535 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-d30d1987-f037-4d69-b851-36ccc0afbd92 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:11.103373 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-d30d1987-f037-4d69-b851-36ccc0afbd92 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:11.103816 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-d30d1987-f037-4d69-b851-36ccc0afbd92 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:11.122407 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.quota [None req-d30d1987-f037-4d69-b851-36ccc0afbd92 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Getting quotas for project 808cc1b3def14c1f8ea4f6635967b351. Resources: {'instances', 'cores', 'ram'} {{(pid=96920) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:57:11.126912 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.quota [None req-d30d1987-f037-4d69-b851-36ccc0afbd92 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Getting quotas for user 31758734d70b471081c8262b0492bc56 and project 808cc1b3def14c1f8ea4f6635967b351. Resources: {'instances', 'cores', 'ram'} {{(pid=96920) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:57:11.140510 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-d30d1987-f037-4d69-b851-36ccc0afbd92 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Going to run 1 instances... {{(pid=96920) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} Apr 08 02:57:11.142860 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-d30d1987-f037-4d69-b851-36ccc0afbd92 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] [instance: 2f5ac86b-8da7-4617-85ef-8e713592845b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7f8ca061-f382-4052-8d05-69f37e107684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=96920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} Apr 08 02:57:11.190679 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-d30d1987-f037-4d69-b851-36ccc0afbd92 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.062629 Apr 08 02:57:11.191639 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 516/1031] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Apr 8 02:57:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1064 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 08 02:57:11.208803 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-86915fae-cdd9-4f17-9d7c-00bd1e4a9f32 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:11.209738 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-86915fae-cdd9-4f17-9d7c-00bd1e4a9f32 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] [instance: 2f5ac86b-8da7-4617-85ef-8e713592845b] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:57:11.306854 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-86915fae-cdd9-4f17-9d7c-00bd1e4a9f32 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31758734d70b471081c8262b0492bc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc1b3def14c1f8ea4f6635967b351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:57:11.315042 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-86915fae-cdd9-4f17-9d7c-00bd1e4a9f32 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] 10.222.0.48 "GET /compute/v2.1/servers/2f5ac86b-8da7-4617-85ef-8e713592845b" status: 200 len: 1214 microversion: 2.1 time: 0.117129 Apr 08 02:57:11.316193 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 517/1032] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:11 2022] GET /compute/v2.1/servers/2f5ac86b-8da7-4617-85ef-8e713592845b => generated 1214 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:57:11.477270 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-a0f65a20-342d-4e55-a56c-55a277ad02a1 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b24e5894c0e435a897a7d397109b4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217aba6f4bb34d35bfc01c21fb7fc95a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:57:11.487634 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-a0f65a20-342d-4e55-a56c-55a277ad02a1 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] 10.222.0.48 "GET /compute/v2.1/servers/f16387f5-f4ba-4ae2-9cfb-a35c14b5b870" status: 200 len: 1315 microversion: 2.1 time: 0.515129 Apr 08 02:57:11.490473 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 516/1033] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:10 2022] GET /compute/v2.1/servers/f16387f5-f4ba-4ae2-9cfb-a35c14b5b870 => generated 1315 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:57:12.337714 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-a8e2425c-d0de-41a1-9a76-d35c97550eeb tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:12.338986 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-a8e2425c-d0de-41a1-9a76-d35c97550eeb tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] [instance: 2f5ac86b-8da7-4617-85ef-8e713592845b] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:57:12.347855 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-a8e2425c-d0de-41a1-9a76-d35c97550eeb tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:12.349302 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-a8e2425c-d0de-41a1-9a76-d35c97550eeb tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:12.350293 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-a8e2425c-d0de-41a1-9a76-d35c97550eeb tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:12.351133 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-a8e2425c-d0de-41a1-9a76-d35c97550eeb tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:12.517024 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-83b1f772-2fac-482d-8966-30b6f105ea7b tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:12.518508 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-83b1f772-2fac-482d-8966-30b6f105ea7b tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] [instance: f16387f5-f4ba-4ae2-9cfb-a35c14b5b870] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:57:12.530721 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-83b1f772-2fac-482d-8966-30b6f105ea7b tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:12.531429 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-83b1f772-2fac-482d-8966-30b6f105ea7b tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:12.532617 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-83b1f772-2fac-482d-8966-30b6f105ea7b tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:12.533297 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-83b1f772-2fac-482d-8966-30b6f105ea7b tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:12.541661 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-a8e2425c-d0de-41a1-9a76-d35c97550eeb tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31758734d70b471081c8262b0492bc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc1b3def14c1f8ea4f6635967b351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:57:12.557718 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-a8e2425c-d0de-41a1-9a76-d35c97550eeb tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] 10.222.0.48 "GET /compute/v2.1/servers/2f5ac86b-8da7-4617-85ef-8e713592845b" status: 200 len: 1284 microversion: 2.1 time: 0.229331 Apr 08 02:57:12.558438 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 518/1034] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:12 2022] GET /compute/v2.1/servers/2f5ac86b-8da7-4617-85ef-8e713592845b => generated 1284 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:57:12.898541 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-83b1f772-2fac-482d-8966-30b6f105ea7b tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b24e5894c0e435a897a7d397109b4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217aba6f4bb34d35bfc01c21fb7fc95a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:57:12.908862 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-83b1f772-2fac-482d-8966-30b6f105ea7b tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] 10.222.0.48 "GET /compute/v2.1/servers/f16387f5-f4ba-4ae2-9cfb-a35c14b5b870" status: 200 len: 1315 microversion: 2.1 time: 0.404766 Apr 08 02:57:12.919590 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 517/1035] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:12 2022] GET /compute/v2.1/servers/f16387f5-f4ba-4ae2-9cfb-a35c14b5b870 => generated 1315 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:57:13.579828 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-3022c7fe-1a9c-4fc2-b8e3-921743348c86 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:13.581172 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-3022c7fe-1a9c-4fc2-b8e3-921743348c86 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] [instance: 2f5ac86b-8da7-4617-85ef-8e713592845b] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:57:13.589390 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-3022c7fe-1a9c-4fc2-b8e3-921743348c86 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:13.590088 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-3022c7fe-1a9c-4fc2-b8e3-921743348c86 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:13.591106 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-3022c7fe-1a9c-4fc2-b8e3-921743348c86 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:13.591538 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-3022c7fe-1a9c-4fc2-b8e3-921743348c86 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:13.608959 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [req-54b80fff-f35d-41b0-830f-4ea0bf6070d9 req-ab1335d1-efd7-4ce7-8e39-124230d94a4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db095363-7817-4713-9eb0-3bcda511112e", "tag": "1ff823af-42f9-4594-93e9-62f6e5e8c8b1"}]} {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:57:13.617591 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:57:13.617591 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: warnings.warn(msg) Apr 08 02:57:13.628581 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-54b80fff-f35d-41b0-830f-4ea0bf6070d9 req-ab1335d1-efd7-4ce7-8e39-124230d94a4f service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:13.629036 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-54b80fff-f35d-41b0-830f-4ea0bf6070d9 req-ab1335d1-efd7-4ce7-8e39-124230d94a4f service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:13.649173 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.compute.server_external_events [req-54b80fff-f35d-41b0-830f-4ea0bf6070d9 req-ab1335d1-efd7-4ce7-8e39-124230d94a4f service nova] Creating event network-changed:1ff823af-42f9-4594-93e9-62f6e5e8c8b1 for instance db095363-7817-4713-9eb0-3bcda511112e on hv-cinder-83705 Apr 08 02:57:13.655235 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [req-54b80fff-f35d-41b0-830f-4ea0bf6070d9 req-ab1335d1-efd7-4ce7-8e39-124230d94a4f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.218982 Apr 08 02:57:13.655994 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 519/1036] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:57:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:57:13.810733 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-3022c7fe-1a9c-4fc2-b8e3-921743348c86 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31758734d70b471081c8262b0492bc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc1b3def14c1f8ea4f6635967b351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:57:13.819844 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-3022c7fe-1a9c-4fc2-b8e3-921743348c86 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] 10.222.0.48 "GET /compute/v2.1/servers/2f5ac86b-8da7-4617-85ef-8e713592845b" status: 200 len: 1314 microversion: 2.1 time: 0.248902 Apr 08 02:57:13.820470 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 518/1037] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:13 2022] GET /compute/v2.1/servers/2f5ac86b-8da7-4617-85ef-8e713592845b => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:57:13.933615 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-b403260b-21b3-4978-a24e-23a6a414e303 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:13.934311 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-b403260b-21b3-4978-a24e-23a6a414e303 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] [instance: f16387f5-f4ba-4ae2-9cfb-a35c14b5b870] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:57:13.942072 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b403260b-21b3-4978-a24e-23a6a414e303 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:13.942650 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b403260b-21b3-4978-a24e-23a6a414e303 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:13.943460 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b403260b-21b3-4978-a24e-23a6a414e303 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:13.945025 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b403260b-21b3-4978-a24e-23a6a414e303 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:14.315098 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-b403260b-21b3-4978-a24e-23a6a414e303 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b24e5894c0e435a897a7d397109b4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217aba6f4bb34d35bfc01c21fb7fc95a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:57:14.323345 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-b403260b-21b3-4978-a24e-23a6a414e303 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] 10.222.0.48 "GET /compute/v2.1/servers/f16387f5-f4ba-4ae2-9cfb-a35c14b5b870" status: 200 len: 1315 microversion: 2.1 time: 0.400072 Apr 08 02:57:14.324075 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 520/1038] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:13 2022] GET /compute/v2.1/servers/f16387f5-f4ba-4ae2-9cfb-a35c14b5b870 => generated 1315 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:57:14.737384 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [req-4aa378a3-b88b-479a-b553-d80f2beb38cc req-8b610d61-50de-466e-838b-e8123630ffad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f5ac86b-8da7-4617-85ef-8e713592845b", "tag": "38b8a2f5-4a50-47cc-873c-b76bf9549725"}]} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:57:14.745641 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:57:14.745641 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: warnings.warn(msg) Apr 08 02:57:14.755726 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-4aa378a3-b88b-479a-b553-d80f2beb38cc req-8b610d61-50de-466e-838b-e8123630ffad service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:14.756661 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-4aa378a3-b88b-479a-b553-d80f2beb38cc req-8b610d61-50de-466e-838b-e8123630ffad service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:14.774036 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.compute.server_external_events [req-4aa378a3-b88b-479a-b553-d80f2beb38cc req-8b610d61-50de-466e-838b-e8123630ffad service nova] Creating event network-changed:38b8a2f5-4a50-47cc-873c-b76bf9549725 for instance 2f5ac86b-8da7-4617-85ef-8e713592845b on hv-cinder-83705 Apr 08 02:57:14.779669 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [req-4aa378a3-b88b-479a-b553-d80f2beb38cc req-8b610d61-50de-466e-838b-e8123630ffad service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051254 Apr 08 02:57:14.780864 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 519/1039] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:57:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 02:57:14.843770 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-bfa80a63-b2ce-4790-b2dc-7ef46ea71d47 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:14.844968 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-bfa80a63-b2ce-4790-b2dc-7ef46ea71d47 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] [instance: 2f5ac86b-8da7-4617-85ef-8e713592845b] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:57:14.854151 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-bfa80a63-b2ce-4790-b2dc-7ef46ea71d47 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:14.854884 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-bfa80a63-b2ce-4790-b2dc-7ef46ea71d47 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:14.855832 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-bfa80a63-b2ce-4790-b2dc-7ef46ea71d47 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:14.856416 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-bfa80a63-b2ce-4790-b2dc-7ef46ea71d47 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:15.077547 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-bfa80a63-b2ce-4790-b2dc-7ef46ea71d47 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31758734d70b471081c8262b0492bc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc1b3def14c1f8ea4f6635967b351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:57:15.087290 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-bfa80a63-b2ce-4790-b2dc-7ef46ea71d47 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] 10.222.0.48 "GET /compute/v2.1/servers/2f5ac86b-8da7-4617-85ef-8e713592845b" status: 200 len: 1314 microversion: 2.1 time: 0.253980 Apr 08 02:57:15.088157 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 521/1040] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:14 2022] GET /compute/v2.1/servers/2f5ac86b-8da7-4617-85ef-8e713592845b => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:57:15.346331 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-53ccf035-8366-4d37-a5d6-e410f1f5a39b tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:15.347140 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-53ccf035-8366-4d37-a5d6-e410f1f5a39b tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] [instance: f16387f5-f4ba-4ae2-9cfb-a35c14b5b870] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:57:15.355699 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-53ccf035-8366-4d37-a5d6-e410f1f5a39b tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:15.356149 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-53ccf035-8366-4d37-a5d6-e410f1f5a39b tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:15.356931 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-53ccf035-8366-4d37-a5d6-e410f1f5a39b tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:15.357366 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-53ccf035-8366-4d37-a5d6-e410f1f5a39b tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:15.672753 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-53ccf035-8366-4d37-a5d6-e410f1f5a39b tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b24e5894c0e435a897a7d397109b4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217aba6f4bb34d35bfc01c21fb7fc95a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:57:15.680798 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-53ccf035-8366-4d37-a5d6-e410f1f5a39b tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] 10.222.0.48 "GET /compute/v2.1/servers/f16387f5-f4ba-4ae2-9cfb-a35c14b5b870" status: 200 len: 1315 microversion: 2.1 time: 0.344052 Apr 08 02:57:15.681343 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 520/1041] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:15 2022] GET /compute/v2.1/servers/f16387f5-f4ba-4ae2-9cfb-a35c14b5b870 => generated 1315 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:57:16.109740 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-9aed26a0-b029-4df5-815a-785d3619c6cc tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:16.110333 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-9aed26a0-b029-4df5-815a-785d3619c6cc tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] [instance: 2f5ac86b-8da7-4617-85ef-8e713592845b] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:57:16.118115 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-9aed26a0-b029-4df5-815a-785d3619c6cc tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:16.118561 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-9aed26a0-b029-4df5-815a-785d3619c6cc tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:16.119371 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-9aed26a0-b029-4df5-815a-785d3619c6cc tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:16.119787 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-9aed26a0-b029-4df5-815a-785d3619c6cc tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:16.316178 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-9aed26a0-b029-4df5-815a-785d3619c6cc tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31758734d70b471081c8262b0492bc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc1b3def14c1f8ea4f6635967b351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:57:16.324214 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-9aed26a0-b029-4df5-815a-785d3619c6cc tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] 10.222.0.48 "GET /compute/v2.1/servers/2f5ac86b-8da7-4617-85ef-8e713592845b" status: 200 len: 1314 microversion: 2.1 time: 0.223295 Apr 08 02:57:16.324744 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 522/1042] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:16 2022] GET /compute/v2.1/servers/2f5ac86b-8da7-4617-85ef-8e713592845b => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:57:16.702987 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-b8b48095-165a-4fe9-8705-f3ed2a736c7a tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:16.703589 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-b8b48095-165a-4fe9-8705-f3ed2a736c7a tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] [instance: f16387f5-f4ba-4ae2-9cfb-a35c14b5b870] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:57:16.710863 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b8b48095-165a-4fe9-8705-f3ed2a736c7a tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:16.711297 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b8b48095-165a-4fe9-8705-f3ed2a736c7a tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:16.712056 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b8b48095-165a-4fe9-8705-f3ed2a736c7a tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:16.712490 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b8b48095-165a-4fe9-8705-f3ed2a736c7a tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:16.818535 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [req-2f23efa1-a7a6-450c-b40a-7723be3b2f26 req-50c52de5-3f06-4dc5-8cb6-e38a468733cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f16387f5-f4ba-4ae2-9cfb-a35c14b5b870", "name": "network-vif-plugged", "status": "completed", "tag": "a6ea4052-8f54-4729-83de-50ef43ebc525"}]} {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:57:16.825466 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:57:16.825466 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: warnings.warn(msg) Apr 08 02:57:16.833512 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-2f23efa1-a7a6-450c-b40a-7723be3b2f26 req-50c52de5-3f06-4dc5-8cb6-e38a468733cc service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:16.833946 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-2f23efa1-a7a6-450c-b40a-7723be3b2f26 req-50c52de5-3f06-4dc5-8cb6-e38a468733cc service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:16.850449 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.compute.server_external_events [req-2f23efa1-a7a6-450c-b40a-7723be3b2f26 req-50c52de5-3f06-4dc5-8cb6-e38a468733cc service nova] Creating event network-vif-plugged:a6ea4052-8f54-4729-83de-50ef43ebc525 for instance f16387f5-f4ba-4ae2-9cfb-a35c14b5b870 on hv-cinder-83705 Apr 08 02:57:16.855232 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [req-2f23efa1-a7a6-450c-b40a-7723be3b2f26 req-50c52de5-3f06-4dc5-8cb6-e38a468733cc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047208 Apr 08 02:57:16.856107 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 523/1043] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:57:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:57:16.928641 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-b8b48095-165a-4fe9-8705-f3ed2a736c7a tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b24e5894c0e435a897a7d397109b4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217aba6f4bb34d35bfc01c21fb7fc95a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:57:16.936803 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-b8b48095-165a-4fe9-8705-f3ed2a736c7a tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] 10.222.0.48 "GET /compute/v2.1/servers/f16387f5-f4ba-4ae2-9cfb-a35c14b5b870" status: 200 len: 1315 microversion: 2.1 time: 0.242781 Apr 08 02:57:16.937339 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 521/1044] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:16 2022] GET /compute/v2.1/servers/f16387f5-f4ba-4ae2-9cfb-a35c14b5b870 => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:57:17.346001 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-1a5f9b88-9d6c-44b2-99d2-721d8a8dc2e6 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:17.346700 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-1a5f9b88-9d6c-44b2-99d2-721d8a8dc2e6 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] [instance: 2f5ac86b-8da7-4617-85ef-8e713592845b] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:57:17.354119 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-1a5f9b88-9d6c-44b2-99d2-721d8a8dc2e6 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:17.354552 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-1a5f9b88-9d6c-44b2-99d2-721d8a8dc2e6 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:17.355333 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-1a5f9b88-9d6c-44b2-99d2-721d8a8dc2e6 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:17.355756 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-1a5f9b88-9d6c-44b2-99d2-721d8a8dc2e6 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:17.555872 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-1a5f9b88-9d6c-44b2-99d2-721d8a8dc2e6 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31758734d70b471081c8262b0492bc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc1b3def14c1f8ea4f6635967b351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:57:17.563681 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-1a5f9b88-9d6c-44b2-99d2-721d8a8dc2e6 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] 10.222.0.48 "GET /compute/v2.1/servers/2f5ac86b-8da7-4617-85ef-8e713592845b" status: 200 len: 1314 microversion: 2.1 time: 0.227064 Apr 08 02:57:17.564194 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 524/1045] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:17 2022] GET /compute/v2.1/servers/2f5ac86b-8da7-4617-85ef-8e713592845b => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:57:17.959003 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-3dc1079e-23aa-4c81-9735-8e3d25ff5ae6 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:17.959601 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-3dc1079e-23aa-4c81-9735-8e3d25ff5ae6 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] [instance: f16387f5-f4ba-4ae2-9cfb-a35c14b5b870] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:57:17.966987 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-3dc1079e-23aa-4c81-9735-8e3d25ff5ae6 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:17.967537 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-3dc1079e-23aa-4c81-9735-8e3d25ff5ae6 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:17.968353 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-3dc1079e-23aa-4c81-9735-8e3d25ff5ae6 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:17.968782 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-3dc1079e-23aa-4c81-9735-8e3d25ff5ae6 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:18.170935 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-3dc1079e-23aa-4c81-9735-8e3d25ff5ae6 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b24e5894c0e435a897a7d397109b4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217aba6f4bb34d35bfc01c21fb7fc95a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:57:18.178860 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-3dc1079e-23aa-4c81-9735-8e3d25ff5ae6 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] 10.222.0.48 "GET /compute/v2.1/servers/f16387f5-f4ba-4ae2-9cfb-a35c14b5b870" status: 200 len: 1315 microversion: 2.1 time: 0.229465 Apr 08 02:57:18.179382 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 522/1046] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:17 2022] GET /compute/v2.1/servers/f16387f5-f4ba-4ae2-9cfb-a35c14b5b870 => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:57:18.585850 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-ef5ff593-c7d9-4d67-a32e-225e8fa0cfe2 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:18.586447 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-ef5ff593-c7d9-4d67-a32e-225e8fa0cfe2 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] [instance: 2f5ac86b-8da7-4617-85ef-8e713592845b] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:57:18.593589 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-ef5ff593-c7d9-4d67-a32e-225e8fa0cfe2 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:18.594019 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-ef5ff593-c7d9-4d67-a32e-225e8fa0cfe2 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:18.594813 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-ef5ff593-c7d9-4d67-a32e-225e8fa0cfe2 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:18.595245 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-ef5ff593-c7d9-4d67-a32e-225e8fa0cfe2 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:18.797143 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-ef5ff593-c7d9-4d67-a32e-225e8fa0cfe2 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31758734d70b471081c8262b0492bc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc1b3def14c1f8ea4f6635967b351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:57:18.805825 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-ef5ff593-c7d9-4d67-a32e-225e8fa0cfe2 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] 10.222.0.48 "GET /compute/v2.1/servers/2f5ac86b-8da7-4617-85ef-8e713592845b" status: 200 len: 1314 microversion: 2.1 time: 0.229415 Apr 08 02:57:18.806359 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 525/1047] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:18 2022] GET /compute/v2.1/servers/2f5ac86b-8da7-4617-85ef-8e713592845b => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:57:19.200759 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-3b94cb2a-b184-4e60-9be4-d21164127348 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:19.201379 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-3b94cb2a-b184-4e60-9be4-d21164127348 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] [instance: f16387f5-f4ba-4ae2-9cfb-a35c14b5b870] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:57:19.208515 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-3b94cb2a-b184-4e60-9be4-d21164127348 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:19.208949 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-3b94cb2a-b184-4e60-9be4-d21164127348 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:19.209710 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-3b94cb2a-b184-4e60-9be4-d21164127348 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:19.210133 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-3b94cb2a-b184-4e60-9be4-d21164127348 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:19.415882 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-3b94cb2a-b184-4e60-9be4-d21164127348 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b24e5894c0e435a897a7d397109b4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217aba6f4bb34d35bfc01c21fb7fc95a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:57:19.424002 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-3b94cb2a-b184-4e60-9be4-d21164127348 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] 10.222.0.48 "GET /compute/v2.1/servers/f16387f5-f4ba-4ae2-9cfb-a35c14b5b870" status: 200 len: 1464 microversion: 2.1 time: 0.232407 Apr 08 02:57:19.424529 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 523/1048] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:19 2022] GET /compute/v2.1/servers/f16387f5-f4ba-4ae2-9cfb-a35c14b5b870 => generated 1464 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:57:19.497929 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-64028ca7-0c3a-4458-b5db-d09080de90c1 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:19.498417 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-64028ca7-0c3a-4458-b5db-d09080de90c1 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] [instance: f16387f5-f4ba-4ae2-9cfb-a35c14b5b870] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:57:19.505636 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-64028ca7-0c3a-4458-b5db-d09080de90c1 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:19.506071 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-64028ca7-0c3a-4458-b5db-d09080de90c1 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:19.506858 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-64028ca7-0c3a-4458-b5db-d09080de90c1 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:19.507287 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-64028ca7-0c3a-4458-b5db-d09080de90c1 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:19.571136 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-64028ca7-0c3a-4458-b5db-d09080de90c1 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] [instance: f16387f5-f4ba-4ae2-9cfb-a35c14b5b870] Going to try to terminate instance {{(pid=96920) delete /opt/stack/nova/nova/compute/api.py:2559}} Apr 08 02:57:19.683496 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-64028ca7-0c3a-4458-b5db-d09080de90c1 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f16387f5-f4ba-4ae2-9cfb-a35c14b5b870" status: 204 len: 0 microversion: 2.1 time: 0.194597 Apr 08 02:57:19.684185 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 526/1049] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Apr 8 02:57:19 2022] DELETE /compute/v2.1/servers/f16387f5-f4ba-4ae2-9cfb-a35c14b5b870 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 08 02:57:19.698073 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-5281a7ac-0e7d-4a84-bd9f-773067006865 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:19.698697 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-5281a7ac-0e7d-4a84-bd9f-773067006865 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] [instance: f16387f5-f4ba-4ae2-9cfb-a35c14b5b870] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:57:19.705752 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-5281a7ac-0e7d-4a84-bd9f-773067006865 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:19.706191 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-5281a7ac-0e7d-4a84-bd9f-773067006865 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:19.707014 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-5281a7ac-0e7d-4a84-bd9f-773067006865 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:19.708053 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-5281a7ac-0e7d-4a84-bd9f-773067006865 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:19.828279 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-96b5375c-c2a5-427d-b7c0-5fafcd9c25d7 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:19.829526 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-96b5375c-c2a5-427d-b7c0-5fafcd9c25d7 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] [instance: 2f5ac86b-8da7-4617-85ef-8e713592845b] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:57:19.837042 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-96b5375c-c2a5-427d-b7c0-5fafcd9c25d7 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:19.837477 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-96b5375c-c2a5-427d-b7c0-5fafcd9c25d7 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:19.838239 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-96b5375c-c2a5-427d-b7c0-5fafcd9c25d7 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:19.838682 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-96b5375c-c2a5-427d-b7c0-5fafcd9c25d7 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:19.915289 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-5281a7ac-0e7d-4a84-bd9f-773067006865 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b24e5894c0e435a897a7d397109b4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217aba6f4bb34d35bfc01c21fb7fc95a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:57:19.924707 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-5281a7ac-0e7d-4a84-bd9f-773067006865 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] 10.222.0.48 "GET /compute/v2.1/servers/f16387f5-f4ba-4ae2-9cfb-a35c14b5b870" status: 200 len: 1470 microversion: 2.1 time: 0.235857 Apr 08 02:57:19.925344 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 524/1050] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:19 2022] GET /compute/v2.1/servers/f16387f5-f4ba-4ae2-9cfb-a35c14b5b870 => generated 1470 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:57:20.043037 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-96b5375c-c2a5-427d-b7c0-5fafcd9c25d7 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31758734d70b471081c8262b0492bc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc1b3def14c1f8ea4f6635967b351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:57:20.050953 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-96b5375c-c2a5-427d-b7c0-5fafcd9c25d7 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] 10.222.0.48 "GET /compute/v2.1/servers/2f5ac86b-8da7-4617-85ef-8e713592845b" status: 200 len: 1314 microversion: 2.1 time: 0.232176 Apr 08 02:57:20.051473 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 527/1051] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:19 2022] GET /compute/v2.1/servers/2f5ac86b-8da7-4617-85ef-8e713592845b => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:57:20.844066 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [req-fd50b6b5-c78a-46c0-8798-30af1eaab8c1 req-f65693b7-d3b5-4304-b571-350b40ebd04a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f5ac86b-8da7-4617-85ef-8e713592845b", "name": "network-vif-plugged", "status": "completed", "tag": "38b8a2f5-4a50-47cc-873c-b76bf9549725"}]} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:57:20.850694 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:57:20.850694 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: warnings.warn(msg) Apr 08 02:57:20.858725 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-fd50b6b5-c78a-46c0-8798-30af1eaab8c1 req-f65693b7-d3b5-4304-b571-350b40ebd04a service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:20.859160 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-fd50b6b5-c78a-46c0-8798-30af1eaab8c1 req-f65693b7-d3b5-4304-b571-350b40ebd04a service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:20.875694 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.compute.server_external_events [req-fd50b6b5-c78a-46c0-8798-30af1eaab8c1 req-f65693b7-d3b5-4304-b571-350b40ebd04a service nova] Creating event network-vif-plugged:38b8a2f5-4a50-47cc-873c-b76bf9549725 for instance 2f5ac86b-8da7-4617-85ef-8e713592845b on hv-cinder-83705 Apr 08 02:57:20.880230 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [req-fd50b6b5-c78a-46c0-8798-30af1eaab8c1 req-f65693b7-d3b5-4304-b571-350b40ebd04a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045082 Apr 08 02:57:20.880802 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 525/1052] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:57:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:57:20.947563 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-20f0f240-a69c-4b1d-9926-f5c5c9b1d962 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:20.948316 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-20f0f240-a69c-4b1d-9926-f5c5c9b1d962 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] [instance: f16387f5-f4ba-4ae2-9cfb-a35c14b5b870] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:57:20.955805 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-20f0f240-a69c-4b1d-9926-f5c5c9b1d962 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:20.956254 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-20f0f240-a69c-4b1d-9926-f5c5c9b1d962 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:20.957033 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-20f0f240-a69c-4b1d-9926-f5c5c9b1d962 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:20.958040 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-20f0f240-a69c-4b1d-9926-f5c5c9b1d962 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:21.074264 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-5476e25f-045c-4a1d-90c8-353c1b30f9f7 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:21.075332 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-5476e25f-045c-4a1d-90c8-353c1b30f9f7 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] [instance: 2f5ac86b-8da7-4617-85ef-8e713592845b] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:57:21.085870 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-5476e25f-045c-4a1d-90c8-353c1b30f9f7 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:21.086340 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-5476e25f-045c-4a1d-90c8-353c1b30f9f7 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:21.087224 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-5476e25f-045c-4a1d-90c8-353c1b30f9f7 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:21.088491 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-5476e25f-045c-4a1d-90c8-353c1b30f9f7 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:21.215006 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-20f0f240-a69c-4b1d-9926-f5c5c9b1d962 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b24e5894c0e435a897a7d397109b4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217aba6f4bb34d35bfc01c21fb7fc95a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:57:21.223602 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-20f0f240-a69c-4b1d-9926-f5c5c9b1d962 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] 10.222.0.48 "GET /compute/v2.1/servers/f16387f5-f4ba-4ae2-9cfb-a35c14b5b870" status: 200 len: 1470 microversion: 2.1 time: 0.285474 Apr 08 02:57:21.224146 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 528/1053] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:20 2022] GET /compute/v2.1/servers/f16387f5-f4ba-4ae2-9cfb-a35c14b5b870 => generated 1470 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:57:21.299098 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-5476e25f-045c-4a1d-90c8-353c1b30f9f7 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31758734d70b471081c8262b0492bc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc1b3def14c1f8ea4f6635967b351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:57:21.307208 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-5476e25f-045c-4a1d-90c8-353c1b30f9f7 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] 10.222.0.48 "GET /compute/v2.1/servers/2f5ac86b-8da7-4617-85ef-8e713592845b" status: 200 len: 1314 microversion: 2.1 time: 0.243077 Apr 08 02:57:21.307743 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 526/1054] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:21 2022] GET /compute/v2.1/servers/2f5ac86b-8da7-4617-85ef-8e713592845b => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:57:22.246101 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-6063170b-3ccb-4ffc-8d18-0ea21caba85c tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:22.249156 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-6063170b-3ccb-4ffc-8d18-0ea21caba85c tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] [instance: f16387f5-f4ba-4ae2-9cfb-a35c14b5b870] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:57:22.258547 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-6063170b-3ccb-4ffc-8d18-0ea21caba85c tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:22.259221 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-6063170b-3ccb-4ffc-8d18-0ea21caba85c tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:22.261102 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-6063170b-3ccb-4ffc-8d18-0ea21caba85c tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:22.261102 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-6063170b-3ccb-4ffc-8d18-0ea21caba85c tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:22.337005 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-e3711865-3fa6-4ea4-a62d-1bf10ec338df tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:22.338252 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-e3711865-3fa6-4ea4-a62d-1bf10ec338df tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] [instance: 2f5ac86b-8da7-4617-85ef-8e713592845b] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:57:22.346912 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-e3711865-3fa6-4ea4-a62d-1bf10ec338df tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:22.347538 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-e3711865-3fa6-4ea4-a62d-1bf10ec338df tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:22.349423 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-e3711865-3fa6-4ea4-a62d-1bf10ec338df tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:22.350212 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-e3711865-3fa6-4ea4-a62d-1bf10ec338df tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:22.398002 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-6063170b-3ccb-4ffc-8d18-0ea21caba85c tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b24e5894c0e435a897a7d397109b4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217aba6f4bb34d35bfc01c21fb7fc95a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:57:22.407361 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-6063170b-3ccb-4ffc-8d18-0ea21caba85c tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] 10.222.0.48 "GET /compute/v2.1/servers/f16387f5-f4ba-4ae2-9cfb-a35c14b5b870" status: 200 len: 1428 microversion: 2.1 time: 0.170177 Apr 08 02:57:22.408406 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 529/1055] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:22 2022] GET /compute/v2.1/servers/f16387f5-f4ba-4ae2-9cfb-a35c14b5b870 => generated 1428 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:57:22.419649 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [req-9485586f-ea22-48e7-b1c1-55118f60dd11 req-deeb69a6-af6f-404e-b8bb-efe55ca1614f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f16387f5-f4ba-4ae2-9cfb-a35c14b5b870", "name": "network-vif-deleted", "tag": "a6ea4052-8f54-4729-83de-50ef43ebc525"}]} {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:57:22.426626 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:57:22.426626 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: warnings.warn(msg) Apr 08 02:57:22.435190 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-9485586f-ea22-48e7-b1c1-55118f60dd11 req-deeb69a6-af6f-404e-b8bb-efe55ca1614f service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:22.435885 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-9485586f-ea22-48e7-b1c1-55118f60dd11 req-deeb69a6-af6f-404e-b8bb-efe55ca1614f service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:22.453346 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.compute.server_external_events [req-9485586f-ea22-48e7-b1c1-55118f60dd11 req-deeb69a6-af6f-404e-b8bb-efe55ca1614f service nova] Creating event network-vif-deleted:a6ea4052-8f54-4729-83de-50ef43ebc525 for instance f16387f5-f4ba-4ae2-9cfb-a35c14b5b870 on hv-cinder-83705 Apr 08 02:57:22.459133 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [req-9485586f-ea22-48e7-b1c1-55118f60dd11 req-deeb69a6-af6f-404e-b8bb-efe55ca1614f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049343 Apr 08 02:57:22.460230 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 530/1056] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:57:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:57:22.618778 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-e3711865-3fa6-4ea4-a62d-1bf10ec338df tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31758734d70b471081c8262b0492bc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc1b3def14c1f8ea4f6635967b351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:57:22.626926 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-e3711865-3fa6-4ea4-a62d-1bf10ec338df tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] 10.222.0.48 "GET /compute/v2.1/servers/2f5ac86b-8da7-4617-85ef-8e713592845b" status: 200 len: 1314 microversion: 2.1 time: 0.307041 Apr 08 02:57:22.627461 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 527/1057] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:22 2022] GET /compute/v2.1/servers/2f5ac86b-8da7-4617-85ef-8e713592845b => generated 1314 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 02:57:23.432312 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-24080801-1297-4e03-b91c-4a4a1c33bf96 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:23.433015 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-24080801-1297-4e03-b91c-4a4a1c33bf96 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] [instance: f16387f5-f4ba-4ae2-9cfb-a35c14b5b870] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:57:23.440514 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-24080801-1297-4e03-b91c-4a4a1c33bf96 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:23.440950 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-24080801-1297-4e03-b91c-4a4a1c33bf96 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:23.442560 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-24080801-1297-4e03-b91c-4a4a1c33bf96 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:23.443090 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-24080801-1297-4e03-b91c-4a4a1c33bf96 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:23.492507 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.wsgi [None req-24080801-1297-4e03-b91c-4a4a1c33bf96 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] HTTP exception thrown: Instance f16387f5-f4ba-4ae2-9cfb-a35c14b5b870 could not be found. Apr 08 02:57:23.493073 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-24080801-1297-4e03-b91c-4a4a1c33bf96 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] Returning 404 to user: Instance f16387f5-f4ba-4ae2-9cfb-a35c14b5b870 could not be found. {{(pid=96920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Apr 08 02:57:23.493874 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-24080801-1297-4e03-b91c-4a4a1c33bf96 tempest-VolumesNegativeTest-442762652 tempest-VolumesNegativeTest-442762652-project] 10.222.0.48 "GET /compute/v2.1/servers/f16387f5-f4ba-4ae2-9cfb-a35c14b5b870" status: 404 len: 111 microversion: 2.1 time: 0.071690 Apr 08 02:57:23.494401 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 531/1058] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:23 2022] GET /compute/v2.1/servers/f16387f5-f4ba-4ae2-9cfb-a35c14b5b870 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 02:57:23.649192 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-460f4372-7941-4e6d-a768-d450b40567b0 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:23.649805 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-460f4372-7941-4e6d-a768-d450b40567b0 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] [instance: 2f5ac86b-8da7-4617-85ef-8e713592845b] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:57:23.656911 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-460f4372-7941-4e6d-a768-d450b40567b0 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:23.657349 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-460f4372-7941-4e6d-a768-d450b40567b0 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:23.658109 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-460f4372-7941-4e6d-a768-d450b40567b0 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:23.658535 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-460f4372-7941-4e6d-a768-d450b40567b0 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:23.864690 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-460f4372-7941-4e6d-a768-d450b40567b0 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31758734d70b471081c8262b0492bc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc1b3def14c1f8ea4f6635967b351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:57:23.872897 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-460f4372-7941-4e6d-a768-d450b40567b0 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] 10.222.0.48 "GET /compute/v2.1/servers/2f5ac86b-8da7-4617-85ef-8e713592845b" status: 200 len: 1497 microversion: 2.1 time: 0.232577 Apr 08 02:57:23.873738 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 528/1059] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:23 2022] GET /compute/v2.1/servers/2f5ac86b-8da7-4617-85ef-8e713592845b => generated 1497 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:57:24.499609 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-1a4d366e-c7af-4528-a1e4-e14ed1ddd95f tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:24.500185 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-1a4d366e-c7af-4528-a1e4-e14ed1ddd95f tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] [instance: 2f5ac86b-8da7-4617-85ef-8e713592845b] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:57:24.507507 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-1a4d366e-c7af-4528-a1e4-e14ed1ddd95f tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:24.507964 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-1a4d366e-c7af-4528-a1e4-e14ed1ddd95f tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:24.508745 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-1a4d366e-c7af-4528-a1e4-e14ed1ddd95f tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:24.509181 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-1a4d366e-c7af-4528-a1e4-e14ed1ddd95f tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:24.581452 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-1a4d366e-c7af-4528-a1e4-e14ed1ddd95f tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] [instance: 2f5ac86b-8da7-4617-85ef-8e713592845b] Going to try to terminate instance {{(pid=96920) delete /opt/stack/nova/nova/compute/api.py:2559}} Apr 08 02:57:24.711129 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-1a4d366e-c7af-4528-a1e4-e14ed1ddd95f tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] 10.222.0.48 "DELETE /compute/v2.1/servers/2f5ac86b-8da7-4617-85ef-8e713592845b" status: 204 len: 0 microversion: 2.1 time: 0.220232 Apr 08 02:57:24.711597 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 532/1060] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Apr 8 02:57:24 2022] DELETE /compute/v2.1/servers/2f5ac86b-8da7-4617-85ef-8e713592845b => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 08 02:57:24.725165 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-a7d0758b-cc07-4d1b-8ecd-83710bb191d5 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:24.725760 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-a7d0758b-cc07-4d1b-8ecd-83710bb191d5 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] [instance: 2f5ac86b-8da7-4617-85ef-8e713592845b] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:57:24.732896 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-a7d0758b-cc07-4d1b-8ecd-83710bb191d5 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:24.733334 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-a7d0758b-cc07-4d1b-8ecd-83710bb191d5 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:24.734090 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-a7d0758b-cc07-4d1b-8ecd-83710bb191d5 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:24.734520 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-a7d0758b-cc07-4d1b-8ecd-83710bb191d5 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:24.940837 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-a7d0758b-cc07-4d1b-8ecd-83710bb191d5 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31758734d70b471081c8262b0492bc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc1b3def14c1f8ea4f6635967b351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:57:24.950168 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-a7d0758b-cc07-4d1b-8ecd-83710bb191d5 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] 10.222.0.48 "GET /compute/v2.1/servers/2f5ac86b-8da7-4617-85ef-8e713592845b" status: 200 len: 1503 microversion: 2.1 time: 0.234365 Apr 08 02:57:24.950731 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 529/1061] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:24 2022] GET /compute/v2.1/servers/2f5ac86b-8da7-4617-85ef-8e713592845b => generated 1503 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:57:25.973689 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-0530adb9-1686-4814-af01-fc9aa31dfec5 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:25.974974 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-0530adb9-1686-4814-af01-fc9aa31dfec5 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] [instance: 2f5ac86b-8da7-4617-85ef-8e713592845b] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:57:25.982892 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-0530adb9-1686-4814-af01-fc9aa31dfec5 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:25.983709 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-0530adb9-1686-4814-af01-fc9aa31dfec5 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:25.984981 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-0530adb9-1686-4814-af01-fc9aa31dfec5 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:25.985561 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-0530adb9-1686-4814-af01-fc9aa31dfec5 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:26.197662 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-0530adb9-1686-4814-af01-fc9aa31dfec5 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31758734d70b471081c8262b0492bc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc1b3def14c1f8ea4f6635967b351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:57:26.205714 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-0530adb9-1686-4814-af01-fc9aa31dfec5 tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] 10.222.0.48 "GET /compute/v2.1/servers/2f5ac86b-8da7-4617-85ef-8e713592845b" status: 200 len: 1503 microversion: 2.1 time: 0.241376 Apr 08 02:57:26.206245 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 533/1062] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:25 2022] GET /compute/v2.1/servers/2f5ac86b-8da7-4617-85ef-8e713592845b => generated 1503 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:57:27.048594 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [req-0ffc3c70-52b1-4478-9e06-e733817aaa56 req-2d5abf1d-b34c-42df-9d48-ef86ff57cfd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f5ac86b-8da7-4617-85ef-8e713592845b", "name": "network-vif-deleted", "tag": "38b8a2f5-4a50-47cc-873c-b76bf9549725"}]} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:57:27.055939 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:57:27.055939 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: warnings.warn(msg) Apr 08 02:57:27.066433 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-0ffc3c70-52b1-4478-9e06-e733817aaa56 req-2d5abf1d-b34c-42df-9d48-ef86ff57cfd6 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:27.066911 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-0ffc3c70-52b1-4478-9e06-e733817aaa56 req-2d5abf1d-b34c-42df-9d48-ef86ff57cfd6 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:27.085710 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.compute.server_external_events [req-0ffc3c70-52b1-4478-9e06-e733817aaa56 req-2d5abf1d-b34c-42df-9d48-ef86ff57cfd6 service nova] Creating event network-vif-deleted:38b8a2f5-4a50-47cc-873c-b76bf9549725 for instance 2f5ac86b-8da7-4617-85ef-8e713592845b on hv-cinder-83705 Apr 08 02:57:27.091295 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [req-0ffc3c70-52b1-4478-9e06-e733817aaa56 req-2d5abf1d-b34c-42df-9d48-ef86ff57cfd6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051909 Apr 08 02:57:27.092291 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 530/1063] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:57:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 02:57:27.229364 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-194566b0-91bf-4c6b-b5a9-719121c3d7ac tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:27.229970 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-194566b0-91bf-4c6b-b5a9-719121c3d7ac tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] [instance: 2f5ac86b-8da7-4617-85ef-8e713592845b] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:57:27.237167 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-194566b0-91bf-4c6b-b5a9-719121c3d7ac tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:27.237604 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-194566b0-91bf-4c6b-b5a9-719121c3d7ac tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:27.238396 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-194566b0-91bf-4c6b-b5a9-719121c3d7ac tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:27.238854 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-194566b0-91bf-4c6b-b5a9-719121c3d7ac tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:27.310030 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-194566b0-91bf-4c6b-b5a9-719121c3d7ac tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:27.310383 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-194566b0-91bf-4c6b-b5a9-719121c3d7ac tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:27.310851 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.objects.instance [None req-194566b0-91bf-4c6b-b5a9-719121c3d7ac tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lazy-loading 'fault' on Instance uuid 2f5ac86b-8da7-4617-85ef-8e713592845b {{(pid=96920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 08 02:57:27.373064 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-194566b0-91bf-4c6b-b5a9-719121c3d7ac tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31758734d70b471081c8262b0492bc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808cc1b3def14c1f8ea4f6635967b351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:57:27.382227 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-194566b0-91bf-4c6b-b5a9-719121c3d7ac tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] 10.222.0.48 "GET /compute/v2.1/servers/2f5ac86b-8da7-4617-85ef-8e713592845b" status: 200 len: 1304 microversion: 2.1 time: 0.162607 Apr 08 02:57:27.382791 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 534/1064] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:27 2022] GET /compute/v2.1/servers/2f5ac86b-8da7-4617-85ef-8e713592845b => generated 1304 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:57:28.405916 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-b83495ac-c742-4f17-b977-9e17c4ca4d6f tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:57:28.406540 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-b83495ac-c742-4f17-b977-9e17c4ca4d6f tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] [instance: 2f5ac86b-8da7-4617-85ef-8e713592845b] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:57:28.414361 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b83495ac-c742-4f17-b977-9e17c4ca4d6f tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:28.414846 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b83495ac-c742-4f17-b977-9e17c4ca4d6f tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:28.415617 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b83495ac-c742-4f17-b977-9e17c4ca4d6f tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:57:28.416049 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-b83495ac-c742-4f17-b977-9e17c4ca4d6f tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:57:28.465012 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.wsgi [None req-b83495ac-c742-4f17-b977-9e17c4ca4d6f tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] HTTP exception thrown: Instance 2f5ac86b-8da7-4617-85ef-8e713592845b could not be found. Apr 08 02:57:28.465641 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-b83495ac-c742-4f17-b977-9e17c4ca4d6f tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] Returning 404 to user: Instance 2f5ac86b-8da7-4617-85ef-8e713592845b could not be found. {{(pid=96919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Apr 08 02:57:28.466463 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-b83495ac-c742-4f17-b977-9e17c4ca4d6f tempest-VolumesActionsTest-1887793092 tempest-VolumesActionsTest-1887793092-project] 10.222.0.48 "GET /compute/v2.1/servers/2f5ac86b-8da7-4617-85ef-8e713592845b" status: 404 len: 111 microversion: 2.1 time: 0.070122 Apr 08 02:57:28.467047 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 531/1065] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:57:28 2022] GET /compute/v2.1/servers/2f5ac86b-8da7-4617-85ef-8e713592845b => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 02:59:31.751543 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a7de49e6-731f-4613-b4f9-e7f4456e292e] AMQP server on 10.222.0.48:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 08 02:59:31.760074 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-1f6cd8da-a848-4d10-b3cf-b6f765cecf1e tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:59:31.760558 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-1f6cd8da-a848-4d10-b3cf-b6f765cecf1e tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] [instance: db095363-7817-4713-9eb0-3bcda511112e] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:59:31.764263 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 08 02:59:31.764395 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: Fri Apr 8 02:59:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/db095363-7817-4713-9eb0-3bcda511112e (ip 10.222.0.48) !!! Apr 08 02:59:31.780666 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-1f6cd8da-a848-4d10-b3cf-b6f765cecf1e tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:59:31.781108 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-1f6cd8da-a848-4d10-b3cf-b6f765cecf1e tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:59:31.781874 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-1f6cd8da-a848-4d10-b3cf-b6f765cecf1e tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:59:31.782298 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-1f6cd8da-a848-4d10-b3cf-b6f765cecf1e tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:59:31.846562 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-1f6cd8da-a848-4d10-b3cf-b6f765cecf1e tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] [instance: db095363-7817-4713-9eb0-3bcda511112e] Going to try to terminate instance {{(pid=96920) delete /opt/stack/nova/nova/compute/api.py:2559}} Apr 08 02:59:31.958086 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-1f6cd8da-a848-4d10-b3cf-b6f765cecf1e tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] 10.222.0.48 "DELETE /compute/v2.1/servers/db095363-7817-4713-9eb0-3bcda511112e" status: 204 len: 0 microversion: 2.1 time: 0.207849 Apr 08 02:59:31.958916 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 535/1066] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Apr 8 02:59:31 2022] DELETE /compute/v2.1/servers/db095363-7817-4713-9eb0-3bcda511112e => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 08 02:59:31.973299 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-2d5d69b0-eadb-4be7-9f68-402f1668f828 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:59:31.973981 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-2d5d69b0-eadb-4be7-9f68-402f1668f828 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] [instance: db095363-7817-4713-9eb0-3bcda511112e] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:59:31.977517 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f3579bfd-0989-4d7e-8307-4b43384799a0] AMQP server on 10.222.0.48:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 08 02:59:31.978796 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 08 02:59:31.979009 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: Fri Apr 8 02:59:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/db095363-7817-4713-9eb0-3bcda511112e (ip 10.222.0.48) !!! Apr 08 02:59:31.990551 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 08 02:59:31.990722 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: Fri Apr 8 02:59:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/db095363-7817-4713-9eb0-3bcda511112e (ip 10.222.0.48) !!! Apr 08 02:59:32.016660 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-2d5d69b0-eadb-4be7-9f68-402f1668f828 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:59:32.017100 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-2d5d69b0-eadb-4be7-9f68-402f1668f828 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:59:32.017877 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-2d5d69b0-eadb-4be7-9f68-402f1668f828 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:59:32.018302 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-2d5d69b0-eadb-4be7-9f68-402f1668f828 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:59:32.223536 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-2d5d69b0-eadb-4be7-9f68-402f1668f828 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d94e2a615ab42aaa79b7c8470f7808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89cf122bfb64dbca81527f5cac790a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:59:32.231510 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-2d5d69b0-eadb-4be7-9f68-402f1668f828 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] 10.222.0.48 "GET /compute/v2.1/servers/db095363-7817-4713-9eb0-3bcda511112e" status: 200 len: 1578 microversion: 2.1 time: 0.267874 Apr 08 02:59:32.232041 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 532/1067] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:59:31 2022] GET /compute/v2.1/servers/db095363-7817-4713-9eb0-3bcda511112e => generated 1578 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:59:33.255519 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-7cd2de2b-ab56-4842-a270-d488a5963300 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:59:33.256188 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-7cd2de2b-ab56-4842-a270-d488a5963300 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] [instance: db095363-7817-4713-9eb0-3bcda511112e] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:59:33.274403 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-7cd2de2b-ab56-4842-a270-d488a5963300 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:59:33.274810 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-7cd2de2b-ab56-4842-a270-d488a5963300 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:59:33.275580 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-7cd2de2b-ab56-4842-a270-d488a5963300 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:59:33.276007 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-7cd2de2b-ab56-4842-a270-d488a5963300 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:59:33.327415 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO oslo.messaging._drivers.impl_rabbit [-] [a7de49e6-731f-4613-b4f9-e7f4456e292e] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 55692. Apr 08 02:59:33.474530 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-7cd2de2b-ab56-4842-a270-d488a5963300 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d94e2a615ab42aaa79b7c8470f7808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89cf122bfb64dbca81527f5cac790a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:59:33.482531 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-7cd2de2b-ab56-4842-a270-d488a5963300 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] 10.222.0.48 "GET /compute/v2.1/servers/db095363-7817-4713-9eb0-3bcda511112e" status: 200 len: 1578 microversion: 2.1 time: 0.237318 Apr 08 02:59:33.483088 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 536/1068] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:59:33 2022] GET /compute/v2.1/servers/db095363-7817-4713-9eb0-3bcda511112e => generated 1578 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:59:34.504926 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-ddcecc58-39a7-4eb2-bb17-812bfcd977a7 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:59:34.505527 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-ddcecc58-39a7-4eb2-bb17-812bfcd977a7 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] [instance: db095363-7817-4713-9eb0-3bcda511112e] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:59:34.525208 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO oslo.messaging._drivers.impl_rabbit [-] [f3579bfd-0989-4d7e-8307-4b43384799a0] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 55696. Apr 08 02:59:34.532700 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ddcecc58-39a7-4eb2-bb17-812bfcd977a7 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:59:34.533206 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ddcecc58-39a7-4eb2-bb17-812bfcd977a7 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:59:34.533919 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ddcecc58-39a7-4eb2-bb17-812bfcd977a7 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:59:34.534421 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ddcecc58-39a7-4eb2-bb17-812bfcd977a7 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:59:34.891093 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-ddcecc58-39a7-4eb2-bb17-812bfcd977a7 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d94e2a615ab42aaa79b7c8470f7808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89cf122bfb64dbca81527f5cac790a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:59:34.899312 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-ddcecc58-39a7-4eb2-bb17-812bfcd977a7 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] 10.222.0.48 "GET /compute/v2.1/servers/db095363-7817-4713-9eb0-3bcda511112e" status: 200 len: 1510 microversion: 2.1 time: 0.403865 Apr 08 02:59:34.899843 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 533/1069] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:59:34 2022] GET /compute/v2.1/servers/db095363-7817-4713-9eb0-3bcda511112e => generated 1510 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:59:35.096178 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [req-b1d1282f-e2ef-4c75-8a19-0bf1417246cc req-ebbd4011-6607-46b0-b56f-6291532f9dbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db095363-7817-4713-9eb0-3bcda511112e", "name": "network-vif-deleted", "tag": "1ff823af-42f9-4594-93e9-62f6e5e8c8b1"}]} {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:59:35.102990 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:59:35.102990 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: warnings.warn(msg) Apr 08 02:59:35.111578 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-b1d1282f-e2ef-4c75-8a19-0bf1417246cc req-ebbd4011-6607-46b0-b56f-6291532f9dbd service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:59:35.112148 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-b1d1282f-e2ef-4c75-8a19-0bf1417246cc req-ebbd4011-6607-46b0-b56f-6291532f9dbd service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:59:35.130373 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.compute.server_external_events [req-b1d1282f-e2ef-4c75-8a19-0bf1417246cc req-ebbd4011-6607-46b0-b56f-6291532f9dbd service nova] Creating event network-vif-deleted:1ff823af-42f9-4594-93e9-62f6e5e8c8b1 for instance db095363-7817-4713-9eb0-3bcda511112e on hv-cinder-83705 Apr 08 02:59:35.134891 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [req-b1d1282f-e2ef-4c75-8a19-0bf1417246cc req-ebbd4011-6607-46b0-b56f-6291532f9dbd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047889 Apr 08 02:59:35.135421 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 537/1070] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:59:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:59:35.922204 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-19395aa8-93e3-4945-99b1-69091def904e tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:59:35.922919 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-19395aa8-93e3-4945-99b1-69091def904e tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] [instance: db095363-7817-4713-9eb0-3bcda511112e] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:59:35.930603 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-19395aa8-93e3-4945-99b1-69091def904e tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:59:35.930845 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-19395aa8-93e3-4945-99b1-69091def904e tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:59:35.931530 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-19395aa8-93e3-4945-99b1-69091def904e tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:59:35.931960 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-19395aa8-93e3-4945-99b1-69091def904e tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:59:35.988493 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.wsgi [None req-19395aa8-93e3-4945-99b1-69091def904e tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] HTTP exception thrown: Instance db095363-7817-4713-9eb0-3bcda511112e could not be found. Apr 08 02:59:35.989206 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-19395aa8-93e3-4945-99b1-69091def904e tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Returning 404 to user: Instance db095363-7817-4713-9eb0-3bcda511112e could not be found. {{(pid=96919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Apr 08 02:59:35.990201 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-19395aa8-93e3-4945-99b1-69091def904e tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] 10.222.0.48 "GET /compute/v2.1/servers/db095363-7817-4713-9eb0-3bcda511112e" status: 404 len: 111 microversion: 2.1 time: 0.077476 Apr 08 02:59:35.991494 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 534/1071] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:59:35 2022] GET /compute/v2.1/servers/db095363-7817-4713-9eb0-3bcda511112e => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 02:59:36.105592 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-82eb230a-0142-4c7e-b34c-9ce8d027958e tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1459070448", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1851240614", "security_groups": [{"name": "tempest-secgroup-smoke-2042401346"}], "block_device_mapping_v2": [{"uuid": "70ea1c94-12b9-4478-8cff-7ed4bb2a87dd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ae66bd3d-676a-4225-963c-1a0fd3518d06"}]}} {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:59:36.396628 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.network.neutron [None req-82eb230a-0142-4c7e-b34c-9ce8d027958e tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] validate_networks() for [('ae66bd3d-676a-4225-963c-1a0fd3518d06', None, None, None)] {{(pid=96920) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} Apr 08 02:59:36.974651 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.virt.hardware [None req-82eb230a-0142-4c7e-b34c-9ce8d027958e tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Flavor limits 0:0:0 {{(pid=96920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} Apr 08 02:59:36.975095 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.virt.hardware [None req-82eb230a-0142-4c7e-b34c-9ce8d027958e tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Image limits 0:0:0 {{(pid=96920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} Apr 08 02:59:36.975556 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.virt.hardware [None req-82eb230a-0142-4c7e-b34c-9ce8d027958e tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Flavor pref 0:0:0 {{(pid=96920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} Apr 08 02:59:36.975979 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.virt.hardware [None req-82eb230a-0142-4c7e-b34c-9ce8d027958e tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Image pref 0:0:0 {{(pid=96920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} Apr 08 02:59:36.976381 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.virt.hardware [None req-82eb230a-0142-4c7e-b34c-9ce8d027958e tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=96920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} Apr 08 02:59:36.984593 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-82eb230a-0142-4c7e-b34c-9ce8d027958e tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:59:36.985024 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-82eb230a-0142-4c7e-b34c-9ce8d027958e tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:59:36.985808 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-82eb230a-0142-4c7e-b34c-9ce8d027958e tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:59:36.986232 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-82eb230a-0142-4c7e-b34c-9ce8d027958e tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:59:37.003991 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.quota [None req-82eb230a-0142-4c7e-b34c-9ce8d027958e tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Getting quotas for project c89cf122bfb64dbca81527f5cac790a5. Resources: {'instances', 'cores', 'ram'} {{(pid=96920) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 02:59:37.008035 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.quota [None req-82eb230a-0142-4c7e-b34c-9ce8d027958e tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Getting quotas for user 6d94e2a615ab42aaa79b7c8470f7808a and project c89cf122bfb64dbca81527f5cac790a5. Resources: {'instances', 'cores', 'ram'} {{(pid=96920) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 02:59:37.098145 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-82eb230a-0142-4c7e-b34c-9ce8d027958e tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Going to run 1 instances... {{(pid=96920) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} Apr 08 02:59:37.100422 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-82eb230a-0142-4c7e-b34c-9ce8d027958e tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] [instance: c8ac8c96-e916-4e02-9a55-603e2f118c1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='70ea1c94-12b9-4478-8cff-7ed4bb2a87dd',volume_size=None,volume_type=None)] {{(pid=96920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} Apr 08 02:59:37.269726 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-82eb230a-0142-4c7e-b34c-9ce8d027958e tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.173863 Apr 08 02:59:37.275403 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 538/1072] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Apr 8 02:59:36 2022] POST /compute/v2.1/servers => generated 406 bytes in 1176 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 08 02:59:37.287354 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-8754f678-3db5-48f9-a042-556b0a805074 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:59:37.287977 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-8754f678-3db5-48f9-a042-556b0a805074 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] [instance: c8ac8c96-e916-4e02-9a55-603e2f118c1f] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:59:37.371363 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-8754f678-3db5-48f9-a042-556b0a805074 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d94e2a615ab42aaa79b7c8470f7808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89cf122bfb64dbca81527f5cac790a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:59:37.379204 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-8754f678-3db5-48f9-a042-556b0a805074 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] 10.222.0.48 "GET /compute/v2.1/servers/c8ac8c96-e916-4e02-9a55-603e2f118c1f" status: 200 len: 1095 microversion: 2.1 time: 0.102578 Apr 08 02:59:37.379924 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 535/1073] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:59:37 2022] GET /compute/v2.1/servers/c8ac8c96-e916-4e02-9a55-603e2f118c1f => generated 1095 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:59:38.402933 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-68a6e9f4-9618-4a1e-8222-e5857ce05459 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:59:38.403654 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-68a6e9f4-9618-4a1e-8222-e5857ce05459 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] [instance: c8ac8c96-e916-4e02-9a55-603e2f118c1f] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:59:38.413133 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-68a6e9f4-9618-4a1e-8222-e5857ce05459 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:59:38.413570 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-68a6e9f4-9618-4a1e-8222-e5857ce05459 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:59:38.414512 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-68a6e9f4-9618-4a1e-8222-e5857ce05459 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:59:38.415481 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-68a6e9f4-9618-4a1e-8222-e5857ce05459 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:59:38.548615 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-68a6e9f4-9618-4a1e-8222-e5857ce05459 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d94e2a615ab42aaa79b7c8470f7808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89cf122bfb64dbca81527f5cac790a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:59:38.558462 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-68a6e9f4-9618-4a1e-8222-e5857ce05459 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] 10.222.0.48 "GET /compute/v2.1/servers/c8ac8c96-e916-4e02-9a55-603e2f118c1f" status: 200 len: 1211 microversion: 2.1 time: 0.166248 Apr 08 02:59:38.559186 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 539/1074] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:59:38 2022] GET /compute/v2.1/servers/c8ac8c96-e916-4e02-9a55-603e2f118c1f => generated 1211 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:59:39.580502 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-73d28b5d-a3b8-481a-9709-bec44d171280 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:59:39.581759 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-73d28b5d-a3b8-481a-9709-bec44d171280 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] [instance: c8ac8c96-e916-4e02-9a55-603e2f118c1f] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:59:39.589678 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-73d28b5d-a3b8-481a-9709-bec44d171280 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:59:39.590119 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-73d28b5d-a3b8-481a-9709-bec44d171280 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:59:39.590924 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-73d28b5d-a3b8-481a-9709-bec44d171280 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:59:39.591356 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-73d28b5d-a3b8-481a-9709-bec44d171280 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:59:39.796481 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-73d28b5d-a3b8-481a-9709-bec44d171280 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d94e2a615ab42aaa79b7c8470f7808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89cf122bfb64dbca81527f5cac790a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:59:39.805053 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-73d28b5d-a3b8-481a-9709-bec44d171280 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] 10.222.0.48 "GET /compute/v2.1/servers/c8ac8c96-e916-4e02-9a55-603e2f118c1f" status: 200 len: 1267 microversion: 2.1 time: 0.233352 Apr 08 02:59:39.805584 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 536/1075] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:59:39 2022] GET /compute/v2.1/servers/c8ac8c96-e916-4e02-9a55-603e2f118c1f => generated 1267 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:59:40.311476 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [req-f002c926-0707-4d81-9eed-61fe863d60d4 req-f819920f-8236-4834-a37b-bfe43edfe91e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8ac8c96-e916-4e02-9a55-603e2f118c1f", "tag": "e93a60d8-1d6c-47a1-98c9-62da80d15ffe"}]} {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:59:40.320667 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:59:40.320667 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: warnings.warn(msg) Apr 08 02:59:40.329544 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-f002c926-0707-4d81-9eed-61fe863d60d4 req-f819920f-8236-4834-a37b-bfe43edfe91e service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:59:40.330063 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-f002c926-0707-4d81-9eed-61fe863d60d4 req-f819920f-8236-4834-a37b-bfe43edfe91e service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:59:40.347834 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.compute.server_external_events [req-f002c926-0707-4d81-9eed-61fe863d60d4 req-f819920f-8236-4834-a37b-bfe43edfe91e service nova] Creating event network-changed:e93a60d8-1d6c-47a1-98c9-62da80d15ffe for instance c8ac8c96-e916-4e02-9a55-603e2f118c1f on hv-cinder-83705 Apr 08 02:59:40.352386 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [req-f002c926-0707-4d81-9eed-61fe863d60d4 req-f819920f-8236-4834-a37b-bfe43edfe91e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058815 Apr 08 02:59:40.353039 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 540/1076] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:59:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:59:40.826912 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-791a16ab-c633-49ab-9c9c-10cba058663c tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:59:40.827468 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-791a16ab-c633-49ab-9c9c-10cba058663c tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] [instance: c8ac8c96-e916-4e02-9a55-603e2f118c1f] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:59:40.835481 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-791a16ab-c633-49ab-9c9c-10cba058663c tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:59:40.835919 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-791a16ab-c633-49ab-9c9c-10cba058663c tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:59:40.836685 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-791a16ab-c633-49ab-9c9c-10cba058663c tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:59:40.837107 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-791a16ab-c633-49ab-9c9c-10cba058663c tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:59:41.039143 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-791a16ab-c633-49ab-9c9c-10cba058663c tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d94e2a615ab42aaa79b7c8470f7808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89cf122bfb64dbca81527f5cac790a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:59:41.047321 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-791a16ab-c633-49ab-9c9c-10cba058663c tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] 10.222.0.48 "GET /compute/v2.1/servers/c8ac8c96-e916-4e02-9a55-603e2f118c1f" status: 200 len: 1267 microversion: 2.1 time: 0.229429 Apr 08 02:59:41.047848 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 537/1077] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:59:40 2022] GET /compute/v2.1/servers/c8ac8c96-e916-4e02-9a55-603e2f118c1f => generated 1267 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:59:42.069902 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-fd7cdac9-ad0d-4f5e-bc67-25c7edb467de tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:59:42.070589 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-fd7cdac9-ad0d-4f5e-bc67-25c7edb467de tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] [instance: c8ac8c96-e916-4e02-9a55-603e2f118c1f] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:59:42.078020 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-fd7cdac9-ad0d-4f5e-bc67-25c7edb467de tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:59:42.078464 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-fd7cdac9-ad0d-4f5e-bc67-25c7edb467de tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:59:42.079260 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-fd7cdac9-ad0d-4f5e-bc67-25c7edb467de tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:59:42.079692 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-fd7cdac9-ad0d-4f5e-bc67-25c7edb467de tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:59:42.283030 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-fd7cdac9-ad0d-4f5e-bc67-25c7edb467de tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d94e2a615ab42aaa79b7c8470f7808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89cf122bfb64dbca81527f5cac790a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:59:42.291491 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-fd7cdac9-ad0d-4f5e-bc67-25c7edb467de tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] 10.222.0.48 "GET /compute/v2.1/servers/c8ac8c96-e916-4e02-9a55-603e2f118c1f" status: 200 len: 1267 microversion: 2.1 time: 0.231331 Apr 08 02:59:42.292024 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 541/1078] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:59:42 2022] GET /compute/v2.1/servers/c8ac8c96-e916-4e02-9a55-603e2f118c1f => generated 1267 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:59:43.316779 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-9dbdf524-ed3a-4941-bb15-d4b7de3eed2e tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:59:43.317303 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-9dbdf524-ed3a-4941-bb15-d4b7de3eed2e tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] [instance: c8ac8c96-e916-4e02-9a55-603e2f118c1f] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:59:43.324499 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-9dbdf524-ed3a-4941-bb15-d4b7de3eed2e tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:59:43.324941 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-9dbdf524-ed3a-4941-bb15-d4b7de3eed2e tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:59:43.325701 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-9dbdf524-ed3a-4941-bb15-d4b7de3eed2e tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:59:43.326123 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-9dbdf524-ed3a-4941-bb15-d4b7de3eed2e tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:59:43.521599 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-9dbdf524-ed3a-4941-bb15-d4b7de3eed2e tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d94e2a615ab42aaa79b7c8470f7808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89cf122bfb64dbca81527f5cac790a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:59:43.529768 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-9dbdf524-ed3a-4941-bb15-d4b7de3eed2e tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] 10.222.0.48 "GET /compute/v2.1/servers/c8ac8c96-e916-4e02-9a55-603e2f118c1f" status: 200 len: 1267 microversion: 2.1 time: 0.225965 Apr 08 02:59:43.530311 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 538/1079] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:59:43 2022] GET /compute/v2.1/servers/c8ac8c96-e916-4e02-9a55-603e2f118c1f => generated 1267 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:59:44.552065 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-a74bf7cb-38c2-47b4-bc1e-28c303abadf1 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:59:44.552649 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-a74bf7cb-38c2-47b4-bc1e-28c303abadf1 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] [instance: c8ac8c96-e916-4e02-9a55-603e2f118c1f] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:59:44.559775 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-a74bf7cb-38c2-47b4-bc1e-28c303abadf1 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:59:44.560206 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-a74bf7cb-38c2-47b4-bc1e-28c303abadf1 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:59:44.560952 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-a74bf7cb-38c2-47b4-bc1e-28c303abadf1 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:59:44.561371 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-a74bf7cb-38c2-47b4-bc1e-28c303abadf1 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:59:44.759876 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-a74bf7cb-38c2-47b4-bc1e-28c303abadf1 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d94e2a615ab42aaa79b7c8470f7808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89cf122bfb64dbca81527f5cac790a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:59:44.768154 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-a74bf7cb-38c2-47b4-bc1e-28c303abadf1 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] 10.222.0.48 "GET /compute/v2.1/servers/c8ac8c96-e916-4e02-9a55-603e2f118c1f" status: 200 len: 1267 microversion: 2.1 time: 0.225583 Apr 08 02:59:44.768779 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 542/1080] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:59:44 2022] GET /compute/v2.1/servers/c8ac8c96-e916-4e02-9a55-603e2f118c1f => generated 1267 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:59:45.790015 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-7cdcea3b-2660-4e37-b669-f1d400dd9ff0 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:59:45.790613 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-7cdcea3b-2660-4e37-b669-f1d400dd9ff0 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] [instance: c8ac8c96-e916-4e02-9a55-603e2f118c1f] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:59:45.797722 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-7cdcea3b-2660-4e37-b669-f1d400dd9ff0 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:59:45.798161 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-7cdcea3b-2660-4e37-b669-f1d400dd9ff0 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:59:45.798945 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-7cdcea3b-2660-4e37-b669-f1d400dd9ff0 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:59:45.799372 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-7cdcea3b-2660-4e37-b669-f1d400dd9ff0 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:59:46.004362 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-7cdcea3b-2660-4e37-b669-f1d400dd9ff0 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d94e2a615ab42aaa79b7c8470f7808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89cf122bfb64dbca81527f5cac790a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:59:46.012721 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-7cdcea3b-2660-4e37-b669-f1d400dd9ff0 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] 10.222.0.48 "GET /compute/v2.1/servers/c8ac8c96-e916-4e02-9a55-603e2f118c1f" status: 200 len: 1267 microversion: 2.1 time: 0.231644 Apr 08 02:59:46.013259 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 539/1081] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:59:45 2022] GET /compute/v2.1/servers/c8ac8c96-e916-4e02-9a55-603e2f118c1f => generated 1267 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:59:47.034608 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-b82f0671-8fd6-4f49-a68f-34e786d010f2 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:59:47.035236 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-b82f0671-8fd6-4f49-a68f-34e786d010f2 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] [instance: c8ac8c96-e916-4e02-9a55-603e2f118c1f] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:59:47.042479 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b82f0671-8fd6-4f49-a68f-34e786d010f2 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:59:47.042946 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b82f0671-8fd6-4f49-a68f-34e786d010f2 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:59:47.043705 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b82f0671-8fd6-4f49-a68f-34e786d010f2 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:59:47.044130 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b82f0671-8fd6-4f49-a68f-34e786d010f2 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:59:47.243688 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-b82f0671-8fd6-4f49-a68f-34e786d010f2 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d94e2a615ab42aaa79b7c8470f7808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89cf122bfb64dbca81527f5cac790a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:59:47.251647 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-b82f0671-8fd6-4f49-a68f-34e786d010f2 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] 10.222.0.48 "GET /compute/v2.1/servers/c8ac8c96-e916-4e02-9a55-603e2f118c1f" status: 200 len: 1267 microversion: 2.1 time: 0.226446 Apr 08 02:59:47.252167 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 543/1082] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:59:47 2022] GET /compute/v2.1/servers/c8ac8c96-e916-4e02-9a55-603e2f118c1f => generated 1267 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:59:48.274334 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-33eb564c-6c0b-4dca-a813-a8d83ffaf641 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:59:48.274918 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-33eb564c-6c0b-4dca-a813-a8d83ffaf641 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] [instance: c8ac8c96-e916-4e02-9a55-603e2f118c1f] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:59:48.281874 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-33eb564c-6c0b-4dca-a813-a8d83ffaf641 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:59:48.282312 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-33eb564c-6c0b-4dca-a813-a8d83ffaf641 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:59:48.283108 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-33eb564c-6c0b-4dca-a813-a8d83ffaf641 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:59:48.283536 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-33eb564c-6c0b-4dca-a813-a8d83ffaf641 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:59:48.482290 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-33eb564c-6c0b-4dca-a813-a8d83ffaf641 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d94e2a615ab42aaa79b7c8470f7808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89cf122bfb64dbca81527f5cac790a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:59:48.490929 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-33eb564c-6c0b-4dca-a813-a8d83ffaf641 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] 10.222.0.48 "GET /compute/v2.1/servers/c8ac8c96-e916-4e02-9a55-603e2f118c1f" status: 200 len: 1267 microversion: 2.1 time: 0.226106 Apr 08 02:59:48.491450 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 540/1083] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:59:48 2022] GET /compute/v2.1/servers/c8ac8c96-e916-4e02-9a55-603e2f118c1f => generated 1267 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:59:49.513601 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-b1bcfe75-0a15-4333-aa6c-22f108c62215 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:59:49.514175 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-b1bcfe75-0a15-4333-aa6c-22f108c62215 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] [instance: c8ac8c96-e916-4e02-9a55-603e2f118c1f] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:59:49.521454 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b1bcfe75-0a15-4333-aa6c-22f108c62215 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:59:49.521879 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b1bcfe75-0a15-4333-aa6c-22f108c62215 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:59:49.522645 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b1bcfe75-0a15-4333-aa6c-22f108c62215 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:59:49.523089 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-b1bcfe75-0a15-4333-aa6c-22f108c62215 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:59:49.731805 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-b1bcfe75-0a15-4333-aa6c-22f108c62215 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d94e2a615ab42aaa79b7c8470f7808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89cf122bfb64dbca81527f5cac790a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:59:49.740495 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-b1bcfe75-0a15-4333-aa6c-22f108c62215 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] 10.222.0.48 "GET /compute/v2.1/servers/c8ac8c96-e916-4e02-9a55-603e2f118c1f" status: 200 len: 1267 microversion: 2.1 time: 0.236324 Apr 08 02:59:49.741020 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 544/1084] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:59:49 2022] GET /compute/v2.1/servers/c8ac8c96-e916-4e02-9a55-603e2f118c1f => generated 1267 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:59:50.762025 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-bf14ccd6-d467-44b0-9257-5bfdcdce41dd tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:59:50.762616 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-bf14ccd6-d467-44b0-9257-5bfdcdce41dd tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] [instance: c8ac8c96-e916-4e02-9a55-603e2f118c1f] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:59:50.770068 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-bf14ccd6-d467-44b0-9257-5bfdcdce41dd tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:59:50.770513 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-bf14ccd6-d467-44b0-9257-5bfdcdce41dd tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:59:50.771309 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-bf14ccd6-d467-44b0-9257-5bfdcdce41dd tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:59:50.771743 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-bf14ccd6-d467-44b0-9257-5bfdcdce41dd tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:59:50.974468 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-bf14ccd6-d467-44b0-9257-5bfdcdce41dd tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d94e2a615ab42aaa79b7c8470f7808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89cf122bfb64dbca81527f5cac790a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:59:50.982705 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-bf14ccd6-d467-44b0-9257-5bfdcdce41dd tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] 10.222.0.48 "GET /compute/v2.1/servers/c8ac8c96-e916-4e02-9a55-603e2f118c1f" status: 200 len: 1267 microversion: 2.1 time: 0.229910 Apr 08 02:59:50.983242 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 541/1085] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:59:50 2022] GET /compute/v2.1/servers/c8ac8c96-e916-4e02-9a55-603e2f118c1f => generated 1267 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:59:51.575556 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [req-08eb0c2f-f0cb-47b3-91e2-239f96917eb7 req-2082dea5-dc47-4844-8fba-075f95353ab3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8ac8c96-e916-4e02-9a55-603e2f118c1f", "name": "network-vif-plugged", "status": "completed", "tag": "e93a60d8-1d6c-47a1-98c9-62da80d15ffe"}]} {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:59:51.582223 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:59:51.582223 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: warnings.warn(msg) Apr 08 02:59:51.590237 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-08eb0c2f-f0cb-47b3-91e2-239f96917eb7 req-2082dea5-dc47-4844-8fba-075f95353ab3 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:59:51.590686 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-08eb0c2f-f0cb-47b3-91e2-239f96917eb7 req-2082dea5-dc47-4844-8fba-075f95353ab3 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:59:51.606820 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.compute.server_external_events [req-08eb0c2f-f0cb-47b3-91e2-239f96917eb7 req-2082dea5-dc47-4844-8fba-075f95353ab3 service nova] Creating event network-vif-plugged:e93a60d8-1d6c-47a1-98c9-62da80d15ffe for instance c8ac8c96-e916-4e02-9a55-603e2f118c1f on hv-cinder-83705 Apr 08 02:59:51.611524 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [req-08eb0c2f-f0cb-47b3-91e2-239f96917eb7 req-2082dea5-dc47-4844-8fba-075f95353ab3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044775 Apr 08 02:59:51.612116 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 545/1086] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:59:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 02:59:52.005051 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-9c9e8fd0-8742-4e78-970f-d125c5ecf293 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:59:52.005668 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-9c9e8fd0-8742-4e78-970f-d125c5ecf293 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] [instance: c8ac8c96-e916-4e02-9a55-603e2f118c1f] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:59:52.013128 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-9c9e8fd0-8742-4e78-970f-d125c5ecf293 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:59:52.013575 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-9c9e8fd0-8742-4e78-970f-d125c5ecf293 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:59:52.014343 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-9c9e8fd0-8742-4e78-970f-d125c5ecf293 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:59:52.014815 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-9c9e8fd0-8742-4e78-970f-d125c5ecf293 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:59:52.217821 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-9c9e8fd0-8742-4e78-970f-d125c5ecf293 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d94e2a615ab42aaa79b7c8470f7808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89cf122bfb64dbca81527f5cac790a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:59:52.226145 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-9c9e8fd0-8742-4e78-970f-d125c5ecf293 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] 10.222.0.48 "GET /compute/v2.1/servers/c8ac8c96-e916-4e02-9a55-603e2f118c1f" status: 200 len: 1267 microversion: 2.1 time: 0.230597 Apr 08 02:59:52.226684 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 542/1087] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:59:51 2022] GET /compute/v2.1/servers/c8ac8c96-e916-4e02-9a55-603e2f118c1f => generated 1267 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:59:53.250073 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-0f5d1346-6739-4873-a5f8-66d22c37864e tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:59:53.250820 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-0f5d1346-6739-4873-a5f8-66d22c37864e tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] [instance: c8ac8c96-e916-4e02-9a55-603e2f118c1f] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:59:53.258937 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-0f5d1346-6739-4873-a5f8-66d22c37864e tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:59:53.259378 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-0f5d1346-6739-4873-a5f8-66d22c37864e tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:59:53.260145 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-0f5d1346-6739-4873-a5f8-66d22c37864e tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:59:53.260565 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-0f5d1346-6739-4873-a5f8-66d22c37864e tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:59:53.465233 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-0f5d1346-6739-4873-a5f8-66d22c37864e tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d94e2a615ab42aaa79b7c8470f7808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89cf122bfb64dbca81527f5cac790a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:59:53.473819 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-0f5d1346-6739-4873-a5f8-66d22c37864e tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] 10.222.0.48 "GET /compute/v2.1/servers/c8ac8c96-e916-4e02-9a55-603e2f118c1f" status: 200 len: 1453 microversion: 2.1 time: 0.234052 Apr 08 02:59:53.474349 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 546/1088] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:59:53 2022] GET /compute/v2.1/servers/c8ac8c96-e916-4e02-9a55-603e2f118c1f => generated 1453 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:59:53.495837 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-8d3914db-b7a1-4f6f-bddf-f50d646e5643 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 02:59:53.496430 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-8d3914db-b7a1-4f6f-bddf-f50d646e5643 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] [instance: c8ac8c96-e916-4e02-9a55-603e2f118c1f] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 02:59:53.503674 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-8d3914db-b7a1-4f6f-bddf-f50d646e5643 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:59:53.504113 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-8d3914db-b7a1-4f6f-bddf-f50d646e5643 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:59:53.504864 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-8d3914db-b7a1-4f6f-bddf-f50d646e5643 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:59:53.505290 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-8d3914db-b7a1-4f6f-bddf-f50d646e5643 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:59:53.706054 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-8d3914db-b7a1-4f6f-bddf-f50d646e5643 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d94e2a615ab42aaa79b7c8470f7808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89cf122bfb64dbca81527f5cac790a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 02:59:53.714221 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-8d3914db-b7a1-4f6f-bddf-f50d646e5643 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] 10.222.0.48 "GET /compute/v2.1/servers/c8ac8c96-e916-4e02-9a55-603e2f118c1f" status: 200 len: 1453 microversion: 2.1 time: 0.228134 Apr 08 02:59:53.714793 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 543/1089] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 02:59:53 2022] GET /compute/v2.1/servers/c8ac8c96-e916-4e02-9a55-603e2f118c1f => generated 1453 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 02:59:56.149550 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [req-68941b34-b064-407d-a63e-74559148f842 req-cab403d0-8c2c-4527-9336-85b90e45ed63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8ac8c96-e916-4e02-9a55-603e2f118c1f", "tag": "e93a60d8-1d6c-47a1-98c9-62da80d15ffe"}]} {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 02:59:56.155689 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:59:56.155689 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: warnings.warn(msg) Apr 08 02:59:56.164501 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-68941b34-b064-407d-a63e-74559148f842 req-cab403d0-8c2c-4527-9336-85b90e45ed63 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 02:59:56.164937 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-68941b34-b064-407d-a63e-74559148f842 req-cab403d0-8c2c-4527-9336-85b90e45ed63 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 02:59:56.183785 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.compute.server_external_events [req-68941b34-b064-407d-a63e-74559148f842 req-cab403d0-8c2c-4527-9336-85b90e45ed63 service nova] Creating event network-changed:e93a60d8-1d6c-47a1-98c9-62da80d15ffe for instance c8ac8c96-e916-4e02-9a55-603e2f118c1f on hv-cinder-83705 Apr 08 02:59:56.188441 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [req-68941b34-b064-407d-a63e-74559148f842 req-cab403d0-8c2c-4527-9336-85b90e45ed63 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048697 Apr 08 02:59:56.189015 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 547/1090] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 02:59:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 03:01:52.294033 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-98a19739-c8ac-479b-bcb3-152c003398f6 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1606702478", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1851240614", "security_groups": [{"name": "tempest-secgroup-smoke-2042401346"}], "block_device_mapping_v2": [{"uuid": "e46a5060-1f6c-4fb7-aeba-a7b004a29ee7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ae66bd3d-676a-4225-963c-1a0fd3518d06"}]}} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 03:01:52.320813 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 08 03:01:52.320967 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: Fri Apr 8 03:01:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.48) !!! Apr 08 03:01:52.462811 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.network.neutron [None req-98a19739-c8ac-479b-bcb3-152c003398f6 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] validate_networks() for [('ae66bd3d-676a-4225-963c-1a0fd3518d06', None, None, None)] {{(pid=96919) validate_networks /opt/stack/nova/nova/network/neutron.py:2348}} Apr 08 03:01:53.133311 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.virt.hardware [None req-98a19739-c8ac-479b-bcb3-152c003398f6 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Flavor limits 0:0:0 {{(pid=96919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:345}} Apr 08 03:01:53.133732 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.virt.hardware [None req-98a19739-c8ac-479b-bcb3-152c003398f6 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Image limits 0:0:0 {{(pid=96919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:349}} Apr 08 03:01:53.134197 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.virt.hardware [None req-98a19739-c8ac-479b-bcb3-152c003398f6 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Flavor pref 0:0:0 {{(pid=96919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:385}} Apr 08 03:01:53.134596 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.virt.hardware [None req-98a19739-c8ac-479b-bcb3-152c003398f6 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Image pref 0:0:0 {{(pid=96919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:389}} Apr 08 03:01:53.135025 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.virt.hardware [None req-98a19739-c8ac-479b-bcb3-152c003398f6 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=96919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:427}} Apr 08 03:01:53.144260 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-98a19739-c8ac-479b-bcb3-152c003398f6 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:01:53.144699 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-98a19739-c8ac-479b-bcb3-152c003398f6 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:01:53.145489 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-98a19739-c8ac-479b-bcb3-152c003398f6 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:01:53.145919 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-98a19739-c8ac-479b-bcb3-152c003398f6 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:01:53.163295 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.quota [None req-98a19739-c8ac-479b-bcb3-152c003398f6 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Getting quotas for project c89cf122bfb64dbca81527f5cac790a5. Resources: {'instances', 'cores', 'ram'} {{(pid=96919) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 08 03:01:53.167205 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.quota [None req-98a19739-c8ac-479b-bcb3-152c003398f6 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Getting quotas for user 6d94e2a615ab42aaa79b7c8470f7808a and project c89cf122bfb64dbca81527f5cac790a5. Resources: {'instances', 'cores', 'ram'} {{(pid=96919) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 08 03:01:53.253405 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-98a19739-c8ac-479b-bcb3-152c003398f6 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Going to run 1 instances... {{(pid=96919) _provision_instances /opt/stack/nova/nova/compute/api.py:1282}} Apr 08 03:01:53.255546 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-98a19739-c8ac-479b-bcb3-152c003398f6 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] [instance: 2f91cc38-f492-4926-b1d8-2bf4b8d36a98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e46a5060-1f6c-4fb7-aeba-a7b004a29ee7',volume_size=None,volume_type=None)] {{(pid=96919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1679}} Apr 08 03:01:53.420413 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-98a19739-c8ac-479b-bcb3-152c003398f6 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.135103 Apr 08 03:01:53.421337 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 544/1091] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Apr 8 03:01:52 2022] POST /compute/v2.1/servers => generated 406 bytes in 1137 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 08 03:01:53.430242 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a7de49e6-731f-4613-b4f9-e7f4456e292e] AMQP server on 10.222.0.48:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Apr 08 03:01:53.431092 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 08 03:01:53.431232 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: Fri Apr 8 03:01:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2f91cc38-f492-4926-b1d8-2bf4b8d36a98 (ip 10.222.0.48) !!! Apr 08 03:01:53.458514 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-2ac0ea52-fb5a-46a7-8616-f4e714b0986e tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 03:01:53.459225 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-2ac0ea52-fb5a-46a7-8616-f4e714b0986e tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] [instance: 2f91cc38-f492-4926-b1d8-2bf4b8d36a98] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 03:01:53.537010 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-2ac0ea52-fb5a-46a7-8616-f4e714b0986e tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d94e2a615ab42aaa79b7c8470f7808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89cf122bfb64dbca81527f5cac790a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 03:01:53.544212 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-2ac0ea52-fb5a-46a7-8616-f4e714b0986e tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] 10.222.0.48 "GET /compute/v2.1/servers/2f91cc38-f492-4926-b1d8-2bf4b8d36a98" status: 200 len: 1095 microversion: 2.1 time: 0.116951 Apr 08 03:01:53.544738 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 548/1092] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 03:01:53 2022] GET /compute/v2.1/servers/2f91cc38-f492-4926-b1d8-2bf4b8d36a98 => generated 1095 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 03:01:54.567613 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-d04aa1ab-aa9b-41f6-984c-bc9464dae6a9 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 03:01:54.568197 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-d04aa1ab-aa9b-41f6-984c-bc9464dae6a9 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] [instance: 2f91cc38-f492-4926-b1d8-2bf4b8d36a98] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 03:01:54.576534 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-d04aa1ab-aa9b-41f6-984c-bc9464dae6a9 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:01:54.576975 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-d04aa1ab-aa9b-41f6-984c-bc9464dae6a9 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:01:54.577740 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-d04aa1ab-aa9b-41f6-984c-bc9464dae6a9 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:01:54.578165 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-d04aa1ab-aa9b-41f6-984c-bc9464dae6a9 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:01:54.723050 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-d04aa1ab-aa9b-41f6-984c-bc9464dae6a9 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d94e2a615ab42aaa79b7c8470f7808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89cf122bfb64dbca81527f5cac790a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 03:01:54.733434 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-d04aa1ab-aa9b-41f6-984c-bc9464dae6a9 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] 10.222.0.48 "GET /compute/v2.1/servers/2f91cc38-f492-4926-b1d8-2bf4b8d36a98" status: 200 len: 1193 microversion: 2.1 time: 0.176380 Apr 08 03:01:54.733977 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 545/1093] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 03:01:54 2022] GET /compute/v2.1/servers/2f91cc38-f492-4926-b1d8-2bf4b8d36a98 => generated 1193 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 03:01:55.755564 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-04145e67-f78b-4845-a2b4-3e0987826aee tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 03:01:55.756167 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-04145e67-f78b-4845-a2b4-3e0987826aee tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] [instance: 2f91cc38-f492-4926-b1d8-2bf4b8d36a98] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 03:01:55.775166 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-04145e67-f78b-4845-a2b4-3e0987826aee tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:01:55.775612 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-04145e67-f78b-4845-a2b4-3e0987826aee tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:01:55.776393 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-04145e67-f78b-4845-a2b4-3e0987826aee tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:01:55.776820 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-04145e67-f78b-4845-a2b4-3e0987826aee tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:01:55.830407 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO oslo.messaging._drivers.impl_rabbit [-] [a7de49e6-731f-4613-b4f9-e7f4456e292e] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 55880. Apr 08 03:01:55.996777 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-04145e67-f78b-4845-a2b4-3e0987826aee tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d94e2a615ab42aaa79b7c8470f7808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89cf122bfb64dbca81527f5cac790a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 03:01:56.005619 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-04145e67-f78b-4845-a2b4-3e0987826aee tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] 10.222.0.48 "GET /compute/v2.1/servers/2f91cc38-f492-4926-b1d8-2bf4b8d36a98" status: 200 len: 1267 microversion: 2.1 time: 0.259078 Apr 08 03:01:56.006166 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 549/1094] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 03:01:55 2022] GET /compute/v2.1/servers/2f91cc38-f492-4926-b1d8-2bf4b8d36a98 => generated 1267 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 03:01:56.676755 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [req-ea1fa3d8-3956-443b-bde2-0951f2b98b49 req-e7257236-989f-4ba3-bd54-5a357cf15743 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f91cc38-f492-4926-b1d8-2bf4b8d36a98", "tag": "840eb9a2-1edf-4779-b824-02241d620ebb"}]} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 03:01:56.683815 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 03:01:56.683815 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: warnings.warn(msg) Apr 08 03:01:56.692786 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-ea1fa3d8-3956-443b-bde2-0951f2b98b49 req-e7257236-989f-4ba3-bd54-5a357cf15743 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:01:56.693535 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-ea1fa3d8-3956-443b-bde2-0951f2b98b49 req-e7257236-989f-4ba3-bd54-5a357cf15743 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:01:56.714050 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.compute.server_external_events [req-ea1fa3d8-3956-443b-bde2-0951f2b98b49 req-e7257236-989f-4ba3-bd54-5a357cf15743 service nova] Creating event network-changed:840eb9a2-1edf-4779-b824-02241d620ebb for instance 2f91cc38-f492-4926-b1d8-2bf4b8d36a98 on hv-cinder-83705 Apr 08 03:01:56.719729 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [req-ea1fa3d8-3956-443b-bde2-0951f2b98b49 req-e7257236-989f-4ba3-bd54-5a357cf15743 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144774 Apr 08 03:01:56.721164 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 546/1095] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 03:01:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 03:01:57.028534 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-07c2a555-106e-4c17-a6bc-011a75303905 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 03:01:57.029136 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-07c2a555-106e-4c17-a6bc-011a75303905 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] [instance: 2f91cc38-f492-4926-b1d8-2bf4b8d36a98] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 03:01:57.037094 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-07c2a555-106e-4c17-a6bc-011a75303905 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:01:57.037656 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-07c2a555-106e-4c17-a6bc-011a75303905 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:01:57.038421 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-07c2a555-106e-4c17-a6bc-011a75303905 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:01:57.038883 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-07c2a555-106e-4c17-a6bc-011a75303905 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:01:57.237609 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-07c2a555-106e-4c17-a6bc-011a75303905 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d94e2a615ab42aaa79b7c8470f7808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89cf122bfb64dbca81527f5cac790a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 03:01:57.245526 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-07c2a555-106e-4c17-a6bc-011a75303905 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] 10.222.0.48 "GET /compute/v2.1/servers/2f91cc38-f492-4926-b1d8-2bf4b8d36a98" status: 200 len: 1267 microversion: 2.1 time: 0.226142 Apr 08 03:01:57.246055 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 550/1096] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 03:01:57 2022] GET /compute/v2.1/servers/2f91cc38-f492-4926-b1d8-2bf4b8d36a98 => generated 1267 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 03:01:58.269283 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-4bdfe99e-b838-49f6-97eb-f142ffc62daf tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 03:01:58.269965 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-4bdfe99e-b838-49f6-97eb-f142ffc62daf tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] [instance: 2f91cc38-f492-4926-b1d8-2bf4b8d36a98] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 03:01:58.277338 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-4bdfe99e-b838-49f6-97eb-f142ffc62daf tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:01:58.277781 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-4bdfe99e-b838-49f6-97eb-f142ffc62daf tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:01:58.278539 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-4bdfe99e-b838-49f6-97eb-f142ffc62daf tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:01:58.278996 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-4bdfe99e-b838-49f6-97eb-f142ffc62daf tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:01:58.479495 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-4bdfe99e-b838-49f6-97eb-f142ffc62daf tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d94e2a615ab42aaa79b7c8470f7808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89cf122bfb64dbca81527f5cac790a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 03:01:58.487984 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-4bdfe99e-b838-49f6-97eb-f142ffc62daf tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] 10.222.0.48 "GET /compute/v2.1/servers/2f91cc38-f492-4926-b1d8-2bf4b8d36a98" status: 200 len: 1267 microversion: 2.1 time: 0.228990 Apr 08 03:01:58.488512 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 547/1097] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 03:01:58 2022] GET /compute/v2.1/servers/2f91cc38-f492-4926-b1d8-2bf4b8d36a98 => generated 1267 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 03:01:59.509430 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-6bcba6ea-9fd0-49d4-b48e-c43c1eac66e6 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 03:01:59.510008 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-6bcba6ea-9fd0-49d4-b48e-c43c1eac66e6 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] [instance: 2f91cc38-f492-4926-b1d8-2bf4b8d36a98] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 03:01:59.517443 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-6bcba6ea-9fd0-49d4-b48e-c43c1eac66e6 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:01:59.517882 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-6bcba6ea-9fd0-49d4-b48e-c43c1eac66e6 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:01:59.518644 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-6bcba6ea-9fd0-49d4-b48e-c43c1eac66e6 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:01:59.519095 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-6bcba6ea-9fd0-49d4-b48e-c43c1eac66e6 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:01:59.721395 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-6bcba6ea-9fd0-49d4-b48e-c43c1eac66e6 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d94e2a615ab42aaa79b7c8470f7808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89cf122bfb64dbca81527f5cac790a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 03:01:59.729445 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-6bcba6ea-9fd0-49d4-b48e-c43c1eac66e6 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] 10.222.0.48 "GET /compute/v2.1/servers/2f91cc38-f492-4926-b1d8-2bf4b8d36a98" status: 200 len: 1267 microversion: 2.1 time: 0.229151 Apr 08 03:01:59.729977 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 551/1098] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 03:01:59 2022] GET /compute/v2.1/servers/2f91cc38-f492-4926-b1d8-2bf4b8d36a98 => generated 1267 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 03:02:00.752739 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-e374a90c-146a-42fb-9009-df3ff365e205 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 03:02:00.753345 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-e374a90c-146a-42fb-9009-df3ff365e205 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] [instance: 2f91cc38-f492-4926-b1d8-2bf4b8d36a98] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 03:02:00.760518 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-e374a90c-146a-42fb-9009-df3ff365e205 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:02:00.760963 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-e374a90c-146a-42fb-9009-df3ff365e205 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:02:00.761991 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-e374a90c-146a-42fb-9009-df3ff365e205 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:02:00.762419 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-e374a90c-146a-42fb-9009-df3ff365e205 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:02:00.960405 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-e374a90c-146a-42fb-9009-df3ff365e205 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d94e2a615ab42aaa79b7c8470f7808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89cf122bfb64dbca81527f5cac790a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 03:02:00.968439 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-e374a90c-146a-42fb-9009-df3ff365e205 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] 10.222.0.48 "GET /compute/v2.1/servers/2f91cc38-f492-4926-b1d8-2bf4b8d36a98" status: 200 len: 1267 microversion: 2.1 time: 0.225201 Apr 08 03:02:00.969188 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 548/1099] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 03:02:00 2022] GET /compute/v2.1/servers/2f91cc38-f492-4926-b1d8-2bf4b8d36a98 => generated 1267 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 03:02:01.990690 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-82597571-d93f-4d2d-9934-cbffe5b56ce4 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 03:02:01.991299 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-82597571-d93f-4d2d-9934-cbffe5b56ce4 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] [instance: 2f91cc38-f492-4926-b1d8-2bf4b8d36a98] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 03:02:01.998532 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-82597571-d93f-4d2d-9934-cbffe5b56ce4 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:02:01.999004 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-82597571-d93f-4d2d-9934-cbffe5b56ce4 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:02:01.999762 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-82597571-d93f-4d2d-9934-cbffe5b56ce4 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:02:02.000189 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-82597571-d93f-4d2d-9934-cbffe5b56ce4 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:02:02.203474 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-82597571-d93f-4d2d-9934-cbffe5b56ce4 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d94e2a615ab42aaa79b7c8470f7808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89cf122bfb64dbca81527f5cac790a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 03:02:02.211538 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-82597571-d93f-4d2d-9934-cbffe5b56ce4 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] 10.222.0.48 "GET /compute/v2.1/servers/2f91cc38-f492-4926-b1d8-2bf4b8d36a98" status: 200 len: 1267 microversion: 2.1 time: 0.229841 Apr 08 03:02:02.212064 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 552/1100] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 03:02:01 2022] GET /compute/v2.1/servers/2f91cc38-f492-4926-b1d8-2bf4b8d36a98 => generated 1267 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 03:02:03.233523 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-c8241c1c-da96-458b-9b83-eb0ae4d87603 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 03:02:03.234119 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-c8241c1c-da96-458b-9b83-eb0ae4d87603 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] [instance: 2f91cc38-f492-4926-b1d8-2bf4b8d36a98] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 03:02:03.242305 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-c8241c1c-da96-458b-9b83-eb0ae4d87603 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:02:03.242792 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-c8241c1c-da96-458b-9b83-eb0ae4d87603 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:02:03.243566 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-c8241c1c-da96-458b-9b83-eb0ae4d87603 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:02:03.244002 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-c8241c1c-da96-458b-9b83-eb0ae4d87603 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:02:03.442951 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-c8241c1c-da96-458b-9b83-eb0ae4d87603 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d94e2a615ab42aaa79b7c8470f7808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89cf122bfb64dbca81527f5cac790a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 03:02:03.450875 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-c8241c1c-da96-458b-9b83-eb0ae4d87603 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] 10.222.0.48 "GET /compute/v2.1/servers/2f91cc38-f492-4926-b1d8-2bf4b8d36a98" status: 200 len: 1267 microversion: 2.1 time: 0.226268 Apr 08 03:02:03.451400 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 549/1101] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 03:02:03 2022] GET /compute/v2.1/servers/2f91cc38-f492-4926-b1d8-2bf4b8d36a98 => generated 1267 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 03:02:04.473336 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-a0143d7b-2c41-4f3e-af89-e66361fa9ba5 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 03:02:04.473950 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-a0143d7b-2c41-4f3e-af89-e66361fa9ba5 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] [instance: 2f91cc38-f492-4926-b1d8-2bf4b8d36a98] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 03:02:04.481247 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-a0143d7b-2c41-4f3e-af89-e66361fa9ba5 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:02:04.481680 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-a0143d7b-2c41-4f3e-af89-e66361fa9ba5 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:02:04.482430 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-a0143d7b-2c41-4f3e-af89-e66361fa9ba5 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:02:04.482881 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-a0143d7b-2c41-4f3e-af89-e66361fa9ba5 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:02:04.684261 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-a0143d7b-2c41-4f3e-af89-e66361fa9ba5 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d94e2a615ab42aaa79b7c8470f7808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89cf122bfb64dbca81527f5cac790a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 03:02:04.692519 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-a0143d7b-2c41-4f3e-af89-e66361fa9ba5 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] 10.222.0.48 "GET /compute/v2.1/servers/2f91cc38-f492-4926-b1d8-2bf4b8d36a98" status: 200 len: 1267 microversion: 2.1 time: 0.228626 Apr 08 03:02:04.693044 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 553/1102] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 03:02:04 2022] GET /compute/v2.1/servers/2f91cc38-f492-4926-b1d8-2bf4b8d36a98 => generated 1267 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 03:02:05.713575 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-3a956450-e70a-4f8b-b65f-7723754dd1dc tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 03:02:05.714182 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-3a956450-e70a-4f8b-b65f-7723754dd1dc tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] [instance: 2f91cc38-f492-4926-b1d8-2bf4b8d36a98] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 03:02:05.721873 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-3a956450-e70a-4f8b-b65f-7723754dd1dc tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:02:05.722167 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-3a956450-e70a-4f8b-b65f-7723754dd1dc tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:02:05.722949 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-3a956450-e70a-4f8b-b65f-7723754dd1dc tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:02:05.723373 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-3a956450-e70a-4f8b-b65f-7723754dd1dc tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:02:05.921316 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-3a956450-e70a-4f8b-b65f-7723754dd1dc tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d94e2a615ab42aaa79b7c8470f7808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89cf122bfb64dbca81527f5cac790a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 03:02:05.929580 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-3a956450-e70a-4f8b-b65f-7723754dd1dc tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] 10.222.0.48 "GET /compute/v2.1/servers/2f91cc38-f492-4926-b1d8-2bf4b8d36a98" status: 200 len: 1267 microversion: 2.1 time: 0.225350 Apr 08 03:02:05.930108 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 550/1103] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 03:02:05 2022] GET /compute/v2.1/servers/2f91cc38-f492-4926-b1d8-2bf4b8d36a98 => generated 1267 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 03:02:06.950740 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-06e8ad22-1c50-48f0-be8b-710b91b4da86 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 03:02:06.951324 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-06e8ad22-1c50-48f0-be8b-710b91b4da86 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] [instance: 2f91cc38-f492-4926-b1d8-2bf4b8d36a98] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 03:02:06.958623 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-06e8ad22-1c50-48f0-be8b-710b91b4da86 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:02:06.959100 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-06e8ad22-1c50-48f0-be8b-710b91b4da86 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:02:06.959857 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-06e8ad22-1c50-48f0-be8b-710b91b4da86 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:02:06.960282 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-06e8ad22-1c50-48f0-be8b-710b91b4da86 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:02:07.162262 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-06e8ad22-1c50-48f0-be8b-710b91b4da86 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d94e2a615ab42aaa79b7c8470f7808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89cf122bfb64dbca81527f5cac790a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 03:02:07.170186 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-06e8ad22-1c50-48f0-be8b-710b91b4da86 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] 10.222.0.48 "GET /compute/v2.1/servers/2f91cc38-f492-4926-b1d8-2bf4b8d36a98" status: 200 len: 1267 microversion: 2.1 time: 0.228436 Apr 08 03:02:07.170772 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 554/1104] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 03:02:06 2022] GET /compute/v2.1/servers/2f91cc38-f492-4926-b1d8-2bf4b8d36a98 => generated 1267 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 03:02:08.193562 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-9a161256-5709-497a-b15d-102df2690ccc tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 03:02:08.194163 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-9a161256-5709-497a-b15d-102df2690ccc tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] [instance: 2f91cc38-f492-4926-b1d8-2bf4b8d36a98] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 03:02:08.201282 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-9a161256-5709-497a-b15d-102df2690ccc tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:02:08.201720 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-9a161256-5709-497a-b15d-102df2690ccc tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:02:08.202478 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-9a161256-5709-497a-b15d-102df2690ccc tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:02:08.202929 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-9a161256-5709-497a-b15d-102df2690ccc tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:02:08.308490 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [req-084dc424-fb7b-4995-9424-8102570014fb req-efee2fde-d076-4978-96d3-dcbe4d391502 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f91cc38-f492-4926-b1d8-2bf4b8d36a98", "name": "network-vif-plugged", "status": "completed", "tag": "840eb9a2-1edf-4779-b824-02241d620ebb"}]} {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 03:02:08.314618 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 03:02:08.314618 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: warnings.warn(msg) Apr 08 03:02:08.322950 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-084dc424-fb7b-4995-9424-8102570014fb req-efee2fde-d076-4978-96d3-dcbe4d391502 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:02:08.323383 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [req-084dc424-fb7b-4995-9424-8102570014fb req-efee2fde-d076-4978-96d3-dcbe4d391502 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:02:08.340223 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.compute.server_external_events [req-084dc424-fb7b-4995-9424-8102570014fb req-efee2fde-d076-4978-96d3-dcbe4d391502 service nova] Creating event network-vif-plugged:840eb9a2-1edf-4779-b824-02241d620ebb for instance 2f91cc38-f492-4926-b1d8-2bf4b8d36a98 on hv-cinder-83705 Apr 08 03:02:08.345074 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [req-084dc424-fb7b-4995-9424-8102570014fb req-efee2fde-d076-4978-96d3-dcbe4d391502 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123340 Apr 08 03:02:08.345878 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 555/1105] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 03:02:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 03:02:08.412880 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-9a161256-5709-497a-b15d-102df2690ccc tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d94e2a615ab42aaa79b7c8470f7808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89cf122bfb64dbca81527f5cac790a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 03:02:08.420908 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-9a161256-5709-497a-b15d-102df2690ccc tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] 10.222.0.48 "GET /compute/v2.1/servers/2f91cc38-f492-4926-b1d8-2bf4b8d36a98" status: 200 len: 1267 microversion: 2.1 time: 0.237220 Apr 08 03:02:08.421425 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 551/1106] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 03:02:08 2022] GET /compute/v2.1/servers/2f91cc38-f492-4926-b1d8-2bf4b8d36a98 => generated 1267 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 03:02:09.442862 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-a7de0c1d-1e0e-4323-9204-454323e0e10a tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 03:02:09.443541 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-a7de0c1d-1e0e-4323-9204-454323e0e10a tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] [instance: 2f91cc38-f492-4926-b1d8-2bf4b8d36a98] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 03:02:09.450969 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-a7de0c1d-1e0e-4323-9204-454323e0e10a tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:02:09.451409 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-a7de0c1d-1e0e-4323-9204-454323e0e10a tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:02:09.452159 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-a7de0c1d-1e0e-4323-9204-454323e0e10a tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:02:09.452589 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-a7de0c1d-1e0e-4323-9204-454323e0e10a tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:02:09.649764 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-a7de0c1d-1e0e-4323-9204-454323e0e10a tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d94e2a615ab42aaa79b7c8470f7808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89cf122bfb64dbca81527f5cac790a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 03:02:09.657780 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-a7de0c1d-1e0e-4323-9204-454323e0e10a tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] 10.222.0.48 "GET /compute/v2.1/servers/2f91cc38-f492-4926-b1d8-2bf4b8d36a98" status: 200 len: 1267 microversion: 2.1 time: 0.224437 Apr 08 03:02:09.658313 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 556/1107] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 03:02:09 2022] GET /compute/v2.1/servers/2f91cc38-f492-4926-b1d8-2bf4b8d36a98 => generated 1267 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 03:02:10.679671 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-7f1ec030-8b03-46c8-b147-9227599399df tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 03:02:10.680323 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-7f1ec030-8b03-46c8-b147-9227599399df tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] [instance: 2f91cc38-f492-4926-b1d8-2bf4b8d36a98] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 03:02:10.687382 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-7f1ec030-8b03-46c8-b147-9227599399df tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:02:10.687823 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-7f1ec030-8b03-46c8-b147-9227599399df tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:02:10.688576 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-7f1ec030-8b03-46c8-b147-9227599399df tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:02:10.689001 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-7f1ec030-8b03-46c8-b147-9227599399df tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:02:10.964173 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-7f1ec030-8b03-46c8-b147-9227599399df tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d94e2a615ab42aaa79b7c8470f7808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89cf122bfb64dbca81527f5cac790a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 03:02:10.972761 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-7f1ec030-8b03-46c8-b147-9227599399df tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] 10.222.0.48 "GET /compute/v2.1/servers/2f91cc38-f492-4926-b1d8-2bf4b8d36a98" status: 200 len: 1453 microversion: 2.1 time: 0.302661 Apr 08 03:02:10.973294 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 552/1108] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 03:02:10 2022] GET /compute/v2.1/servers/2f91cc38-f492-4926-b1d8-2bf4b8d36a98 => generated 1453 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 03:02:10.994567 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-47542af6-f230-45ec-8d2c-612b1e52aeee tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 03:02:10.995264 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-47542af6-f230-45ec-8d2c-612b1e52aeee tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] [instance: 2f91cc38-f492-4926-b1d8-2bf4b8d36a98] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 03:02:11.002425 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-47542af6-f230-45ec-8d2c-612b1e52aeee tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:02:11.003044 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-47542af6-f230-45ec-8d2c-612b1e52aeee tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:02:11.003810 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-47542af6-f230-45ec-8d2c-612b1e52aeee tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:02:11.004237 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-47542af6-f230-45ec-8d2c-612b1e52aeee tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:02:11.204298 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-47542af6-f230-45ec-8d2c-612b1e52aeee tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d94e2a615ab42aaa79b7c8470f7808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89cf122bfb64dbca81527f5cac790a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 03:02:11.212992 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-47542af6-f230-45ec-8d2c-612b1e52aeee tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] 10.222.0.48 "GET /compute/v2.1/servers/2f91cc38-f492-4926-b1d8-2bf4b8d36a98" status: 200 len: 1453 microversion: 2.1 time: 0.227797 Apr 08 03:02:11.213462 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 557/1109] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 03:02:10 2022] GET /compute/v2.1/servers/2f91cc38-f492-4926-b1d8-2bf4b8d36a98 => generated 1453 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 03:02:13.769015 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [req-7f71ce88-5e89-41b0-a23f-92765eedc7f4 req-b6e03516-18ee-4c8a-83d2-ce8a78907d8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f91cc38-f492-4926-b1d8-2bf4b8d36a98", "tag": "840eb9a2-1edf-4779-b824-02241d620ebb"}]} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 03:02:13.775109 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 03:02:13.775109 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: warnings.warn(msg) Apr 08 03:02:13.783260 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-7f71ce88-5e89-41b0-a23f-92765eedc7f4 req-b6e03516-18ee-4c8a-83d2-ce8a78907d8a service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:02:13.784345 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-7f71ce88-5e89-41b0-a23f-92765eedc7f4 req-b6e03516-18ee-4c8a-83d2-ce8a78907d8a service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:02:13.800340 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.compute.server_external_events [req-7f71ce88-5e89-41b0-a23f-92765eedc7f4 req-b6e03516-18ee-4c8a-83d2-ce8a78907d8a service nova] Creating event network-changed:840eb9a2-1edf-4779-b824-02241d620ebb for instance 2f91cc38-f492-4926-b1d8-2bf4b8d36a98 on hv-cinder-83705 Apr 08 03:02:13.805109 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [req-7f71ce88-5e89-41b0-a23f-92765eedc7f4 req-b6e03516-18ee-4c8a-83d2-ce8a78907d8a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045290 Apr 08 03:02:13.805687 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 553/1110] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 03:02:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 03:04:04.476393 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f3579bfd-0989-4d7e-8307-4b43384799a0] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 08 03:04:04.477591 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 08 03:04:04.477943 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: Fri Apr 8 03:04:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.48) !!! Apr 08 03:04:04.482860 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-a7ab3dfa-8e90-4439-a969-ec873ab538b8 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 03:04:04.483329 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-a7ab3dfa-8e90-4439-a969-ec873ab538b8 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] [instance: 2f91cc38-f492-4926-b1d8-2bf4b8d36a98] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 03:04:04.487469 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 08 03:04:04.487615 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: Fri Apr 8 03:04:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2f91cc38-f492-4926-b1d8-2bf4b8d36a98 (ip 10.222.0.48) !!! Apr 08 03:04:04.499604 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [req-c0c954e6-e65e-4c05-9c14-80ac4bf7db03 req-dd592293-89ec-48a7-aa6c-4623fa20bed2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f91cc38-f492-4926-b1d8-2bf4b8d36a98", "tag": "840eb9a2-1edf-4779-b824-02241d620ebb"}]} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 03:04:04.507139 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 03:04:04.507139 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: warnings.warn(msg) Apr 08 03:04:04.512220 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-a7ab3dfa-8e90-4439-a969-ec873ab538b8 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:04:04.512662 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-a7ab3dfa-8e90-4439-a969-ec873ab538b8 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:04:04.513428 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-a7ab3dfa-8e90-4439-a969-ec873ab538b8 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:04:04.513849 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-a7ab3dfa-8e90-4439-a969-ec873ab538b8 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:04:04.516336 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-c0c954e6-e65e-4c05-9c14-80ac4bf7db03 req-dd592293-89ec-48a7-aa6c-4623fa20bed2 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:04:04.516788 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-c0c954e6-e65e-4c05-9c14-80ac4bf7db03 req-dd592293-89ec-48a7-aa6c-4623fa20bed2 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:04:04.535832 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.compute.server_external_events [req-c0c954e6-e65e-4c05-9c14-80ac4bf7db03 req-dd592293-89ec-48a7-aa6c-4623fa20bed2 service nova] Creating event network-changed:840eb9a2-1edf-4779-b824-02241d620ebb for instance 2f91cc38-f492-4926-b1d8-2bf4b8d36a98 on hv-cinder-83705 Apr 08 03:04:04.540326 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [req-c0c954e6-e65e-4c05-9c14-80ac4bf7db03 req-dd592293-89ec-48a7-aa6c-4623fa20bed2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065202 Apr 08 03:04:04.541106 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 554/1111] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 03:04:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 08 03:04:04.583969 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-a7ab3dfa-8e90-4439-a969-ec873ab538b8 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] [instance: 2f91cc38-f492-4926-b1d8-2bf4b8d36a98] Going to try to terminate instance {{(pid=96920) delete /opt/stack/nova/nova/compute/api.py:2559}} Apr 08 03:04:04.702846 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-a7ab3dfa-8e90-4439-a969-ec873ab538b8 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] 10.222.0.48 "DELETE /compute/v2.1/servers/2f91cc38-f492-4926-b1d8-2bf4b8d36a98" status: 204 len: 0 microversion: 2.1 time: 0.229332 Apr 08 03:04:04.703729 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 558/1112] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Apr 8 03:04:04 2022] DELETE /compute/v2.1/servers/2f91cc38-f492-4926-b1d8-2bf4b8d36a98 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 08 03:04:04.719310 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-ddd2defe-fffd-41fd-892e-600509794379 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 03:04:04.720027 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-ddd2defe-fffd-41fd-892e-600509794379 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] [instance: 2f91cc38-f492-4926-b1d8-2bf4b8d36a98] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 03:04:04.730205 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ddd2defe-fffd-41fd-892e-600509794379 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:04:04.730854 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ddd2defe-fffd-41fd-892e-600509794379 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:04:04.732198 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ddd2defe-fffd-41fd-892e-600509794379 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:04:04.732676 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-ddd2defe-fffd-41fd-892e-600509794379 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:04:04.944548 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-ddd2defe-fffd-41fd-892e-600509794379 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d94e2a615ab42aaa79b7c8470f7808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89cf122bfb64dbca81527f5cac790a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 03:04:04.953087 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-ddd2defe-fffd-41fd-892e-600509794379 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] 10.222.0.48 "GET /compute/v2.1/servers/2f91cc38-f492-4926-b1d8-2bf4b8d36a98" status: 200 len: 1577 microversion: 2.1 time: 0.245038 Apr 08 03:04:04.955275 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 555/1113] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 03:04:04 2022] GET /compute/v2.1/servers/2f91cc38-f492-4926-b1d8-2bf4b8d36a98 => generated 1577 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 03:04:05.977490 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-3538388a-f34b-4f8b-8f04-a9ee35e1fab8 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 03:04:05.978177 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-3538388a-f34b-4f8b-8f04-a9ee35e1fab8 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] [instance: 2f91cc38-f492-4926-b1d8-2bf4b8d36a98] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 03:04:05.985487 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-3538388a-f34b-4f8b-8f04-a9ee35e1fab8 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:04:05.985931 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-3538388a-f34b-4f8b-8f04-a9ee35e1fab8 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:04:05.986719 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-3538388a-f34b-4f8b-8f04-a9ee35e1fab8 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:04:05.987690 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-3538388a-f34b-4f8b-8f04-a9ee35e1fab8 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:04:06.192384 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-3538388a-f34b-4f8b-8f04-a9ee35e1fab8 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d94e2a615ab42aaa79b7c8470f7808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89cf122bfb64dbca81527f5cac790a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 03:04:06.200571 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-3538388a-f34b-4f8b-8f04-a9ee35e1fab8 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] 10.222.0.48 "GET /compute/v2.1/servers/2f91cc38-f492-4926-b1d8-2bf4b8d36a98" status: 200 len: 1459 microversion: 2.1 time: 0.232784 Apr 08 03:04:06.201099 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 559/1114] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 03:04:05 2022] GET /compute/v2.1/servers/2f91cc38-f492-4926-b1d8-2bf4b8d36a98 => generated 1459 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 03:04:07.224079 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-3ad5e866-826d-4a75-87cc-f3c7b92154c6 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 03:04:07.224797 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [req-ff8ea864-fc69-45dc-9463-7e5d3c6d93ed req-bb4d6c67-cc93-4cb5-9a7d-9471d7768757 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f91cc38-f492-4926-b1d8-2bf4b8d36a98", "name": "network-vif-deleted", "tag": "840eb9a2-1edf-4779-b824-02241d620ebb"}]} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 03:04:07.225430 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-3ad5e866-826d-4a75-87cc-f3c7b92154c6 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] [instance: 2f91cc38-f492-4926-b1d8-2bf4b8d36a98] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 03:04:07.230995 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 03:04:07.230995 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: warnings.warn(msg) Apr 08 03:04:07.233543 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-3ad5e866-826d-4a75-87cc-f3c7b92154c6 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:04:07.233987 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-3ad5e866-826d-4a75-87cc-f3c7b92154c6 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:04:07.235059 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-3ad5e866-826d-4a75-87cc-f3c7b92154c6 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:04:07.235502 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-3ad5e866-826d-4a75-87cc-f3c7b92154c6 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:04:07.251215 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-ff8ea864-fc69-45dc-9463-7e5d3c6d93ed req-bb4d6c67-cc93-4cb5-9a7d-9471d7768757 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:04:07.251951 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-ff8ea864-fc69-45dc-9463-7e5d3c6d93ed req-bb4d6c67-cc93-4cb5-9a7d-9471d7768757 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:04:07.271926 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.compute.server_external_events [req-ff8ea864-fc69-45dc-9463-7e5d3c6d93ed req-bb4d6c67-cc93-4cb5-9a7d-9471d7768757 service nova] Creating event network-vif-deleted:840eb9a2-1edf-4779-b824-02241d620ebb for instance 2f91cc38-f492-4926-b1d8-2bf4b8d36a98 on hv-cinder-83705 Apr 08 03:04:07.276733 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [req-ff8ea864-fc69-45dc-9463-7e5d3c6d93ed req-bb4d6c67-cc93-4cb5-9a7d-9471d7768757 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063039 Apr 08 03:04:07.277356 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 556/1115] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 03:04:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 03:04:07.366194 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-3ad5e866-826d-4a75-87cc-f3c7b92154c6 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d94e2a615ab42aaa79b7c8470f7808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89cf122bfb64dbca81527f5cac790a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 03:04:07.374128 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-3ad5e866-826d-4a75-87cc-f3c7b92154c6 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] 10.222.0.48 "GET /compute/v2.1/servers/2f91cc38-f492-4926-b1d8-2bf4b8d36a98" status: 200 len: 1226 microversion: 2.1 time: 0.160187 Apr 08 03:04:07.374645 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 560/1116] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 03:04:07 2022] GET /compute/v2.1/servers/2f91cc38-f492-4926-b1d8-2bf4b8d36a98 => generated 1226 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 03:04:08.395989 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-6b316c1e-1d60-4e7a-a177-2331101f7cf8 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 03:04:08.396665 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-6b316c1e-1d60-4e7a-a177-2331101f7cf8 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] [instance: 2f91cc38-f492-4926-b1d8-2bf4b8d36a98] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 03:04:08.399598 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO oslo.messaging._drivers.impl_rabbit [-] [f3579bfd-0989-4d7e-8307-4b43384799a0] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 55988. Apr 08 03:04:08.404827 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-6b316c1e-1d60-4e7a-a177-2331101f7cf8 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:04:08.405261 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-6b316c1e-1d60-4e7a-a177-2331101f7cf8 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:04:08.406016 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-6b316c1e-1d60-4e7a-a177-2331101f7cf8 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:04:08.406440 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-6b316c1e-1d60-4e7a-a177-2331101f7cf8 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:04:08.454339 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.wsgi [None req-6b316c1e-1d60-4e7a-a177-2331101f7cf8 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] HTTP exception thrown: Instance 2f91cc38-f492-4926-b1d8-2bf4b8d36a98 could not be found. Apr 08 03:04:08.454940 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-6b316c1e-1d60-4e7a-a177-2331101f7cf8 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Returning 404 to user: Instance 2f91cc38-f492-4926-b1d8-2bf4b8d36a98 could not be found. {{(pid=96919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Apr 08 03:04:08.455761 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-6b316c1e-1d60-4e7a-a177-2331101f7cf8 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] 10.222.0.48 "GET /compute/v2.1/servers/2f91cc38-f492-4926-b1d8-2bf4b8d36a98" status: 404 len: 111 microversion: 2.1 time: 0.069449 Apr 08 03:04:08.456399 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 557/1117] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 03:04:08 2022] GET /compute/v2.1/servers/2f91cc38-f492-4926-b1d8-2bf4b8d36a98 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 03:04:12.441054 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-e63d54d6-0873-4f19-88ed-956158e18b7d tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 03:04:12.441587 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-e63d54d6-0873-4f19-88ed-956158e18b7d tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] [instance: c8ac8c96-e916-4e02-9a55-603e2f118c1f] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 03:04:12.443251 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [req-7b542e56-6be1-48a3-8a44-d663a571b2cb req-24f02651-bcea-4dc8-90ef-3ecb26f1d825 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8ac8c96-e916-4e02-9a55-603e2f118c1f", "tag": "e93a60d8-1d6c-47a1-98c9-62da80d15ffe"}]} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 03:04:12.448969 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-e63d54d6-0873-4f19-88ed-956158e18b7d tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:04:12.449486 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-e63d54d6-0873-4f19-88ed-956158e18b7d tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:04:12.449862 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 03:04:12.449862 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: warnings.warn(msg) Apr 08 03:04:12.450396 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-e63d54d6-0873-4f19-88ed-956158e18b7d tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:04:12.450917 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-e63d54d6-0873-4f19-88ed-956158e18b7d tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:04:12.458797 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-7b542e56-6be1-48a3-8a44-d663a571b2cb req-24f02651-bcea-4dc8-90ef-3ecb26f1d825 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:04:12.459235 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-7b542e56-6be1-48a3-8a44-d663a571b2cb req-24f02651-bcea-4dc8-90ef-3ecb26f1d825 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:04:12.475927 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.compute.server_external_events [req-7b542e56-6be1-48a3-8a44-d663a571b2cb req-24f02651-bcea-4dc8-90ef-3ecb26f1d825 service nova] Creating event network-changed:e93a60d8-1d6c-47a1-98c9-62da80d15ffe for instance c8ac8c96-e916-4e02-9a55-603e2f118c1f on hv-cinder-83705 Apr 08 03:04:12.480590 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [req-7b542e56-6be1-48a3-8a44-d663a571b2cb req-24f02651-bcea-4dc8-90ef-3ecb26f1d825 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046593 Apr 08 03:04:12.481343 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 558/1118] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 03:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 03:04:12.521577 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-e63d54d6-0873-4f19-88ed-956158e18b7d tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] [instance: c8ac8c96-e916-4e02-9a55-603e2f118c1f] Going to try to terminate instance {{(pid=96920) delete /opt/stack/nova/nova/compute/api.py:2559}} Apr 08 03:04:12.642637 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-e63d54d6-0873-4f19-88ed-956158e18b7d tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c8ac8c96-e916-4e02-9a55-603e2f118c1f" status: 204 len: 0 microversion: 2.1 time: 0.210294 Apr 08 03:04:12.647093 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 561/1119] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Apr 8 03:04:12 2022] DELETE /compute/v2.1/servers/c8ac8c96-e916-4e02-9a55-603e2f118c1f => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 08 03:04:12.664596 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-6255301b-d376-4c49-bdfe-b0ea7df65f2a tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 03:04:12.665311 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-6255301b-d376-4c49-bdfe-b0ea7df65f2a tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] [instance: c8ac8c96-e916-4e02-9a55-603e2f118c1f] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 03:04:12.673522 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-6255301b-d376-4c49-bdfe-b0ea7df65f2a tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:04:12.674151 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-6255301b-d376-4c49-bdfe-b0ea7df65f2a tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:04:12.675455 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-6255301b-d376-4c49-bdfe-b0ea7df65f2a tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:04:12.676263 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-6255301b-d376-4c49-bdfe-b0ea7df65f2a tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:04:12.886277 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.policy [None req-6255301b-d376-4c49-bdfe-b0ea7df65f2a tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d94e2a615ab42aaa79b7c8470f7808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89cf122bfb64dbca81527f5cac790a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96919) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 03:04:12.895595 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-6255301b-d376-4c49-bdfe-b0ea7df65f2a tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] 10.222.0.48 "GET /compute/v2.1/servers/c8ac8c96-e916-4e02-9a55-603e2f118c1f" status: 200 len: 1578 microversion: 2.1 time: 0.243520 Apr 08 03:04:12.896358 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 559/1120] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 03:04:12 2022] GET /compute/v2.1/servers/c8ac8c96-e916-4e02-9a55-603e2f118c1f => generated 1578 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 03:04:13.919668 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-c23547ad-6302-4a29-8b3c-aeaba4b4d9ad tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 03:04:13.920350 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-c23547ad-6302-4a29-8b3c-aeaba4b4d9ad tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] [instance: c8ac8c96-e916-4e02-9a55-603e2f118c1f] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 03:04:13.927916 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c23547ad-6302-4a29-8b3c-aeaba4b4d9ad tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:04:13.928350 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c23547ad-6302-4a29-8b3c-aeaba4b4d9ad tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:04:13.929111 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c23547ad-6302-4a29-8b3c-aeaba4b4d9ad tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:04:13.929534 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c23547ad-6302-4a29-8b3c-aeaba4b4d9ad tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:04:14.147218 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-c23547ad-6302-4a29-8b3c-aeaba4b4d9ad tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d94e2a615ab42aaa79b7c8470f7808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89cf122bfb64dbca81527f5cac790a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 03:04:14.155243 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-c23547ad-6302-4a29-8b3c-aeaba4b4d9ad tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] 10.222.0.48 "GET /compute/v2.1/servers/c8ac8c96-e916-4e02-9a55-603e2f118c1f" status: 200 len: 1459 microversion: 2.1 time: 0.245920 Apr 08 03:04:14.155763 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 562/1121] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 03:04:13 2022] GET /compute/v2.1/servers/c8ac8c96-e916-4e02-9a55-603e2f118c1f => generated 1459 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 08 03:04:15.154392 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [req-86611e9a-d825-432b-9f70-327e6aa48559 req-1876d3ca-c099-4cd6-b385-f68bf2082897 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8ac8c96-e916-4e02-9a55-603e2f118c1f", "name": "network-vif-deleted", "tag": "e93a60d8-1d6c-47a1-98c9-62da80d15ffe"}]} {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 08 03:04:15.161147 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 03:04:15.161147 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: warnings.warn(msg) Apr 08 03:04:15.169469 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-86611e9a-d825-432b-9f70-327e6aa48559 req-1876d3ca-c099-4cd6-b385-f68bf2082897 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:04:15.170120 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [req-86611e9a-d825-432b-9f70-327e6aa48559 req-1876d3ca-c099-4cd6-b385-f68bf2082897 service nova] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:04:15.178734 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-c98b51fc-2f91-44fb-b77b-0a7ca6ac5fd1 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 03:04:15.179338 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-c98b51fc-2f91-44fb-b77b-0a7ca6ac5fd1 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] [instance: c8ac8c96-e916-4e02-9a55-603e2f118c1f] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 03:04:15.187463 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.compute.server_external_events [req-86611e9a-d825-432b-9f70-327e6aa48559 req-1876d3ca-c099-4cd6-b385-f68bf2082897 service nova] Creating event network-vif-deleted:e93a60d8-1d6c-47a1-98c9-62da80d15ffe for instance c8ac8c96-e916-4e02-9a55-603e2f118c1f on hv-cinder-83705 Apr 08 03:04:15.187808 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c98b51fc-2f91-44fb-b77b-0a7ca6ac5fd1 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:04:15.188054 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c98b51fc-2f91-44fb-b77b-0a7ca6ac5fd1 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:04:15.189065 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c98b51fc-2f91-44fb-b77b-0a7ca6ac5fd1 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:04:15.189492 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-c98b51fc-2f91-44fb-b77b-0a7ca6ac5fd1 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:04:15.192018 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [req-86611e9a-d825-432b-9f70-327e6aa48559 req-1876d3ca-c099-4cd6-b385-f68bf2082897 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046776 Apr 08 03:04:15.192593 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 560/1122] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Apr 8 03:04:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 08 03:04:15.310887 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.policy [None req-c98b51fc-2f91-44fb-b77b-0a7ca6ac5fd1 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d94e2a615ab42aaa79b7c8470f7808a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89cf122bfb64dbca81527f5cac790a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=96920) authorize /opt/stack/nova/nova/policy.py:222}} Apr 08 03:04:15.319000 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-c98b51fc-2f91-44fb-b77b-0a7ca6ac5fd1 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] 10.222.0.48 "GET /compute/v2.1/servers/c8ac8c96-e916-4e02-9a55-603e2f118c1f" status: 200 len: 1226 microversion: 2.1 time: 0.150484 Apr 08 03:04:15.319524 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 563/1123] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 03:04:15 2022] GET /compute/v2.1/servers/c8ac8c96-e916-4e02-9a55-603e2f118c1f => generated 1226 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 08 03:04:16.340773 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-c8966a45-4f4e-4b3f-8393-257ad6910b3f tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 03:04:16.341458 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-c8966a45-4f4e-4b3f-8393-257ad6910b3f tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] [instance: c8ac8c96-e916-4e02-9a55-603e2f118c1f] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 03:04:16.348876 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-c8966a45-4f4e-4b3f-8393-257ad6910b3f tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:04:16.349320 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-c8966a45-4f4e-4b3f-8393-257ad6910b3f tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:04:16.350081 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-c8966a45-4f4e-4b3f-8393-257ad6910b3f tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:04:16.350512 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-c8966a45-4f4e-4b3f-8393-257ad6910b3f tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:04:16.400562 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.wsgi [None req-c8966a45-4f4e-4b3f-8393-257ad6910b3f tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] HTTP exception thrown: Instance c8ac8c96-e916-4e02-9a55-603e2f118c1f could not be found. Apr 08 03:04:16.401146 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-c8966a45-4f4e-4b3f-8393-257ad6910b3f tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Returning 404 to user: Instance c8ac8c96-e916-4e02-9a55-603e2f118c1f could not be found. {{(pid=96919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Apr 08 03:04:16.401952 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-c8966a45-4f4e-4b3f-8393-257ad6910b3f tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] 10.222.0.48 "GET /compute/v2.1/servers/c8ac8c96-e916-4e02-9a55-603e2f118c1f" status: 404 len: 111 microversion: 2.1 time: 0.070827 Apr 08 03:04:16.402493 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 561/1124] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 03:04:16 2022] GET /compute/v2.1/servers/c8ac8c96-e916-4e02-9a55-603e2f118c1f => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 03:04:17.134523 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-d49722f6-c626-44e8-abcc-fbfb722093fc tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Calling method '>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 03:04:17.135338 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.compute.api [None req-d49722f6-c626-44e8-abcc-fbfb722093fc tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] [instance: db095363-7817-4713-9eb0-3bcda511112e] Fetching instance by UUID {{(pid=96920) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 03:04:17.142340 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-d49722f6-c626-44e8-abcc-fbfb722093fc tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:04:17.143535 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-d49722f6-c626-44e8-abcc-fbfb722093fc tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:04:17.144279 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-d49722f6-c626-44e8-abcc-fbfb722093fc tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:04:17.144699 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG oslo_concurrency.lockutils [None req-d49722f6-c626-44e8-abcc-fbfb722093fc tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:04:17.192726 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.wsgi [None req-d49722f6-c626-44e8-abcc-fbfb722093fc tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] HTTP exception thrown: Instance db095363-7817-4713-9eb0-3bcda511112e could not be found. Apr 08 03:04:17.193305 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-d49722f6-c626-44e8-abcc-fbfb722093fc tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Returning 404 to user: Instance db095363-7817-4713-9eb0-3bcda511112e could not be found. {{(pid=96920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Apr 08 03:04:17.194106 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-d49722f6-c626-44e8-abcc-fbfb722093fc tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] 10.222.0.48 "DELETE /compute/v2.1/servers/db095363-7817-4713-9eb0-3bcda511112e" status: 404 len: 111 microversion: 2.1 time: 0.068859 Apr 08 03:04:17.194633 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 564/1125] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Apr 8 03:04:17 2022] DELETE /compute/v2.1/servers/db095363-7817-4713-9eb0-3bcda511112e => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 03:04:17.208371 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-4237c6c0-ec29-45cf-964f-6b505c32ed85 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Calling method '>' {{(pid=96919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 03:04:17.208964 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.compute.api [None req-4237c6c0-ec29-45cf-964f-6b505c32ed85 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] [instance: db095363-7817-4713-9eb0-3bcda511112e] Fetching instance by UUID {{(pid=96919) get /opt/stack/nova/nova/compute/api.py:2810}} Apr 08 03:04:17.216077 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-4237c6c0-ec29-45cf-964f-6b505c32ed85 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:04:17.216513 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-4237c6c0-ec29-45cf-964f-6b505c32ed85 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:04:17.217269 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-4237c6c0-ec29-45cf-964f-6b505c32ed85 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 08 03:04:17.217691 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG oslo_concurrency.lockutils [None req-4237c6c0-ec29-45cf-964f-6b505c32ed85 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Lock "6d23fd24-1ab4-4f74-87ff-4e24114caf2e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=96919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 08 03:04:17.265659 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.wsgi [None req-4237c6c0-ec29-45cf-964f-6b505c32ed85 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] HTTP exception thrown: Instance db095363-7817-4713-9eb0-3bcda511112e could not be found. Apr 08 03:04:17.266231 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: DEBUG nova.api.openstack.wsgi [None req-4237c6c0-ec29-45cf-964f-6b505c32ed85 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Returning 404 to user: Instance db095363-7817-4713-9eb0-3bcda511112e could not be found. {{(pid=96919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Apr 08 03:04:17.267047 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: INFO nova.api.openstack.requestlog [None req-4237c6c0-ec29-45cf-964f-6b505c32ed85 tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] 10.222.0.48 "GET /compute/v2.1/servers/db095363-7817-4713-9eb0-3bcda511112e" status: 404 len: 111 microversion: 2.1 time: 0.068164 Apr 08 03:04:17.267568 dv-cinder-837052-1-iscsi devstack@n-api.service[96919]: [pid: 96919|app: 0|req: 562/1126] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Apr 8 03:04:17 2022] GET /compute/v2.1/servers/db095363-7817-4713-9eb0-3bcda511112e => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 08 03:04:18.694068 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: DEBUG nova.api.openstack.wsgi [None req-1d48f203-b246-49bc-80c1-023ebb33778b tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] Calling method '.version_select at 0x7f7d4e2afb80>' {{(pid=96920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 08 03:04:18.718652 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: INFO nova.api.openstack.requestlog [None req-1d48f203-b246-49bc-80c1-023ebb33778b tempest-TestVolumeBootPattern-1106698305 tempest-TestVolumeBootPattern-1106698305-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1851240614" status: 202 len: 0 microversion: 2.1 time: 0.034216 Apr 08 03:04:18.719232 dv-cinder-837052-1-iscsi devstack@n-api.service[96920]: [pid: 96920|app: 0|req: 565/1127] 10.222.0.48 () {58 vars in 1262 bytes} [Fri Apr 8 03:04:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1851240614 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)